Skip to content

Add Delta scheme to the integer compressor (unstable_encodings)#8212

Open
joseph-isaacs wants to merge 3 commits into
developfrom
claude/modest-bohr-MHQIy
Open

Add Delta scheme to the integer compressor (unstable_encodings)#8212
joseph-isaacs wants to merge 3 commits into
developfrom
claude/modest-bohr-MHQIy

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs commented Jun 2, 2026

Add a FastLanes Delta encoding as a candidate in the BtrBlocks integer scheme set, gated behind the unstable_encodings feature, in a new schemes/integer/delta.rs module.

Selection uses a deferred callback that delta-encodes the array and measures the real transposed-delta residual span, then estimates the compression ratio as full_width / delta_bits, multiplied by a DELTA_PENALTY (0.9) factor. The penalty makes the selector require Delta to be meaningfully smaller than the best alternative before it wins, rather than picking it for a single-bit gain, since Delta breaks random access and adds a prefix-sum decode pass.

Delta is registered last among the integer schemes so it loses exact estimate ties to simpler, randomly-accessible encodings. A descendant exclusion (plus the compressor's built-in self-exclusion) guarantees Delta is applied at most once along any path in the tree, so already-delta-encoded data is never delta-encoded again.

Tests cover selection on a delta-favorable column, round-tripping, and the no-nested-delta invariant. The existing RLE selection test is updated to use scrambled (non-monotone) run values so it remains run-length-dominant rather than delta-favorable.

Summary

Closes: #000

Testing

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
@joseph-isaacs
u
9e26f48 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs force-pushed the claude/modest-bohr-MHQIy branch from df84a4d to 9e26f48 Compare June 2, 2026 11:06
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 5ecbcb7 2 Explore Profiling Data
Previous Runs (3)
Status Commit Job Attempt Link
🟢 Done 5ecbcb7 1 Explore Profiling Data
🟢 Done df84a4d 2 Explore Profiling Data
🟢 Done df84a4d 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.030x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.030x ➖, 0↑ 2↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 115285559 115993951 0.99
polarsignals_q01/datafusion:vortex-file-compressed 244457905 266945550 0.92
polarsignals_q02/datafusion:vortex-file-compressed 22672464 22932767 0.99
polarsignals_q03/datafusion:vortex-file-compressed 271986911 259815936 1.05
polarsignals_q04/datafusion:vortex-file-compressed 🚨 11542489 10157402 1.14
polarsignals_q05/datafusion:vortex-file-compressed 14410393 13888953 1.04
polarsignals_q06/datafusion:vortex-file-compressed 🚨 18757589 16867925 1.11
polarsignals_q07/datafusion:vortex-file-compressed 13389975 12407218 1.08
polarsignals_q08/datafusion:vortex-file-compressed 390748394 399164788 0.98
polarsignals_q09/datafusion:vortex-file-compressed 10366250 10100498 1.03
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 685.83 MB 685.81 MB 19.64 KB -0.0%

Totals:

  • vortex-file-compressed: 685.83 MB → 685.81 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+1.0%, low confidence)
Vortex (geomean): 0.923x ➖
Parquet (geomean): 0.921x ➖
Shifts: Parquet (control) -7.9% · Median polish -7.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.961x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 6538789 6306569 1.04
fineweb_q01/datafusion:vortex-file-compressed 35157486 35965131 0.98
fineweb_q02/datafusion:vortex-file-compressed 39697439 39441914 1.01
fineweb_q03/datafusion:vortex-file-compressed 70009313 68588940 1.02
fineweb_q04/datafusion:vortex-file-compressed 293846539 317347519 0.93
fineweb_q05/datafusion:vortex-file-compressed 231456025 248436481 0.93
fineweb_q06/datafusion:vortex-file-compressed 51923428 56521612 0.92
fineweb_q07/datafusion:vortex-file-compressed 52896296 57044970 0.93
fineweb_q08/datafusion:vortex-file-compressed 20625695 22575224 0.91
datafusion / vortex-compact (0.894x ✅, 7↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 6004756 6695273 0.90
fineweb_q01/datafusion:vortex-compact 🚀 95449639 107669714 0.89
fineweb_q02/datafusion:vortex-compact 🚀 101024783 118695956 0.85
fineweb_q03/datafusion:vortex-compact 🚀 880134410 994125527 0.89
fineweb_q04/datafusion:vortex-compact 941650608 1035508350 0.91
fineweb_q05/datafusion:vortex-compact 🚀 838034973 939621055 0.89
fineweb_q06/datafusion:vortex-compact 🚀 471428880 531981656 0.89
fineweb_q07/datafusion:vortex-compact 🚀 493290965 551351308 0.89
fineweb_q08/datafusion:vortex-compact 19221851 20328393 0.95
datafusion / parquet (0.930x ➖, 3↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6919159 7226388 0.96
fineweb_q01/datafusion:parquet 🚀 288938524 323055508 0.89
fineweb_q02/datafusion:parquet 🚀 303846660 339114673 0.90
fineweb_q03/datafusion:parquet 305866240 316495384 0.97
fineweb_q04/datafusion:parquet 327472221 340112678 0.96
fineweb_q05/datafusion:parquet 🚀 314368065 353146379 0.89
fineweb_q06/datafusion:parquet 304973543 331493388 0.92
fineweb_q07/datafusion:parquet 300189368 320337231 0.94
fineweb_q08/datafusion:parquet 299836396 315155720 0.95
duckdb / vortex-file-compressed (0.934x ➖, 3↑ 1↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3560337 4259222 0.84
fineweb_q01/duckdb:vortex-file-compressed 35111646 36884912 0.95
fineweb_q02/duckdb:vortex-file-compressed 42515679 43169427 0.98
fineweb_q03/duckdb:vortex-file-compressed 🚨 166779051 151390437 1.10
fineweb_q04/duckdb:vortex-file-compressed 🚀 278567346 313851716 0.89
fineweb_q05/duckdb:vortex-file-compressed 🚀 218759892 249796600 0.88
fineweb_q06/duckdb:vortex-file-compressed 52036479 56515312 0.92
fineweb_q07/duckdb:vortex-file-compressed 55905387 59437060 0.94
fineweb_q08/duckdb:vortex-file-compressed 22407413 24131223 0.93
duckdb / vortex-compact (0.906x ➖, 5↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4450498 4858096 0.92
fineweb_q01/duckdb:vortex-compact 🚀 97287462 112939779 0.86
fineweb_q02/duckdb:vortex-compact 118099872 121850114 0.97
fineweb_q03/duckdb:vortex-compact 🚀 867615082 966824725 0.90
fineweb_q04/duckdb:vortex-compact 🚀 917414531 1031437363 0.89
fineweb_q05/duckdb:vortex-compact 🚀 814611431 928121668 0.88
fineweb_q06/duckdb:vortex-compact 🚀 469407620 541833727 0.87
fineweb_q07/duckdb:vortex-compact 482439968 534862694 0.90
fineweb_q08/duckdb:vortex-compact 21255606 21549761 0.99
duckdb / parquet (0.911x ➖, 2↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 32441809 34668169 0.94
fineweb_q01/duckdb:parquet 90158545 97117695 0.93
fineweb_q02/duckdb:parquet 🚀 88022302 97980522 0.90
fineweb_q03/duckdb:parquet 321194802 352206159 0.91
fineweb_q04/duckdb:parquet 451233431 492013196 0.92
fineweb_q05/duckdb:parquet 419030155 458104067 0.91
fineweb_q06/duckdb:parquet 208672945 226862359 0.92
fineweb_q07/duckdb:parquet 219013591 241596663 0.91
fineweb_q08/duckdb:parquet 🚀 35347739 40717576 0.87
File Size Changes (2 files changed, +0.1% overall, 2↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +1.77 MB +0.1%
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB +4.02 KB +0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (+0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (+0.1%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -10.3% -5.3% -5.3% +48.8% ➖ noise
0 datafusion:vortex-file-compressed +3.7% -5.3% +9.5% +48.5% ➖ noise
0 duckdb:vortex-compact -8.4% -5.3% -3.2% +139.8% ➖ noise
0 duckdb:vortex-file-compressed -16.4% -5.3% -11.7% +73.1% ➖ noise
1 datafusion:vortex-compact -11.3% -8.9% -2.7% +26.6% ➖ noise
1 datafusion:vortex-file-compressed -2.2% -8.9% +7.3% +18.0% ➖ noise
1 duckdb:vortex-compact -13.9% -8.9% -5.5% +12.7% ➖ noise
1 duckdb:vortex-file-compressed -4.8% -8.9% +4.5% +48.9% ➖ noise
2 datafusion:vortex-compact -14.9% -10.3% -5.1% +16.0% ➖ noise
2 datafusion:vortex-file-compressed +0.6% -10.3% +12.2% +24.0% ➖ noise
2 duckdb:vortex-compact -3.1% -10.3% +8.0% +13.4% ➖ noise
2 duckdb:vortex-file-compressed -1.5% -10.3% +9.8% +12.2% ➖ noise
3 datafusion:vortex-compact -11.5% -6.1% -5.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +2.1% -6.1% +8.7% +34.3% ➖ noise
3 duckdb:vortex-compact -10.3% -6.1% -4.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +10.2% -6.1% +17.3% +42.4% ➖ noise
4 datafusion:vortex-compact -9.1% -6.0% -3.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -7.4% -6.0% -1.5% +10.0% ➖ noise
4 duckdb:vortex-compact -11.1% -6.0% -5.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -11.2% -6.0% -5.5% +10.0% ➖ noise
5 datafusion:vortex-compact -10.8% -9.8% -1.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -6.8% -9.8% +3.2% +10.0% ➖ noise
5 duckdb:vortex-compact -12.2% -9.8% -2.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -12.4% -9.8% -2.9% +10.0% ➖ noise
6 datafusion:vortex-compact -11.4% -8.0% -3.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -8.1% -8.0% -0.1% +10.0% ➖ noise
6 duckdb:vortex-compact -13.4% -8.0% -5.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -7.9% -8.0% +0.1% +14.3% ➖ noise
7 datafusion:vortex-compact -10.5% -7.8% -2.9% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -7.3% -7.8% +0.6% +13.5% ➖ noise
7 duckdb:vortex-compact -9.8% -7.8% -2.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.9% -7.8% +2.0% +26.9% ➖ noise
8 datafusion:vortex-compact -5.4% -9.1% +4.0% +24.4% ➖ noise
8 datafusion:vortex-file-compressed -8.6% -9.1% +0.5% +26.9% ➖ noise
8 duckdb:vortex-compact -1.4% -9.1% +8.5% +47.0% ➖ noise
8 duckdb:vortex-file-compressed -7.1% -9.1% +2.2% +32.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+2.5%, environment too noisy confidence) · DuckDB No clear signal (-1.4%, environment too noisy confidence)
Vortex (geomean): 0.994x ➖
Parquet (geomean): 0.981x ➖
Shifts: Parquet (control) -1.9% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.003x ➖, 2↑ 3↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 57992603 55931548 1.04
tpch_q02/datafusion:vortex-file-compressed 🚨 30233280 25467360 1.19
tpch_q03/datafusion:vortex-file-compressed 29331728 31167868 0.94
tpch_q04/datafusion:vortex-file-compressed 🚀 21393046 23782608 0.90
tpch_q05/datafusion:vortex-file-compressed 54596124 58236180 0.94
tpch_q06/datafusion:vortex-file-compressed 11414959 11881951 0.96
tpch_q07/datafusion:vortex-file-compressed 60223056 63962937 0.94
tpch_q08/datafusion:vortex-file-compressed 🚨 51574589 45804458 1.13
tpch_q09/datafusion:vortex-file-compressed 61329840 58650090 1.05
tpch_q10/datafusion:vortex-file-compressed 46826880 51442384 0.91
tpch_q11/datafusion:vortex-file-compressed 🚨 21760961 18266030 1.19
tpch_q12/datafusion:vortex-file-compressed 26813637 27217513 0.99
tpch_q13/datafusion:vortex-file-compressed 29829676 29532317 1.01
tpch_q14/datafusion:vortex-file-compressed 17881907 17857108 1.00
tpch_q15/datafusion:vortex-file-compressed 29020353 26677442 1.09
tpch_q16/datafusion:vortex-file-compressed 21416230 21804831 0.98
tpch_q17/datafusion:vortex-file-compressed 79995826 75085378 1.07
tpch_q18/datafusion:vortex-file-compressed 86423859 92651492 0.93
tpch_q19/datafusion:vortex-file-compressed 21494886 22476657 0.96
tpch_q20/datafusion:vortex-file-compressed 33692899 32530468 1.04
tpch_q21/datafusion:vortex-file-compressed 🚀 74626222 83896732 0.89
tpch_q22/datafusion:vortex-file-compressed 12938909 12830791 1.01
datafusion / vortex-compact (0.966x ➖, 0↑ 1↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59531124 61781914 0.96
tpch_q02/datafusion:vortex-compact 27198792 28734020 0.95
tpch_q03/datafusion:vortex-compact 🚨 35875864 31582879 1.14
tpch_q04/datafusion:vortex-compact 22637649 24817669 0.91
tpch_q05/datafusion:vortex-compact 57060008 55792710 1.02
tpch_q06/datafusion:vortex-compact 12793525 13677862 0.94
tpch_q07/datafusion:vortex-compact 60892791 66580273 0.91
tpch_q08/datafusion:vortex-compact 44321585 48087454 0.92
tpch_q09/datafusion:vortex-compact 62537870 60845082 1.03
tpch_q10/datafusion:vortex-compact 46381585 49356261 0.94
tpch_q11/datafusion:vortex-compact 19600696 18723918 1.05
tpch_q12/datafusion:vortex-compact 32314195 33283823 0.97
tpch_q13/datafusion:vortex-compact 32755540 34066230 0.96
tpch_q14/datafusion:vortex-compact 20174218 19754937 1.02
tpch_q15/datafusion:vortex-compact 32375961 34100574 0.95
tpch_q16/datafusion:vortex-compact 25123841 27385081 0.92
tpch_q17/datafusion:vortex-compact 75299015 77960310 0.97
tpch_q18/datafusion:vortex-compact 89120129 97533400 0.91
tpch_q19/datafusion:vortex-compact 32308570 33449034 0.97
tpch_q20/datafusion:vortex-compact 34530780 38349570 0.90
tpch_q21/datafusion:vortex-compact 88996615 87477686 1.02
tpch_q22/datafusion:vortex-compact 12929124 13870931 0.93
datafusion / parquet (0.944x ➖, 2↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 122826696 123208655 1.00
tpch_q02/datafusion:parquet 🚀 60911680 70757357 0.86
tpch_q03/datafusion:parquet 70317809 77331346 0.91
tpch_q04/datafusion:parquet 43012964 46628311 0.92
tpch_q05/datafusion:parquet 92538177 101788505 0.91
tpch_q06/datafusion:parquet 38391901 41492187 0.93
tpch_q07/datafusion:parquet 106325212 115332317 0.92
tpch_q08/datafusion:parquet 98724348 100677333 0.98
tpch_q09/datafusion:parquet 131405327 137930118 0.95
tpch_q10/datafusion:parquet 112140802 121712448 0.92
tpch_q11/datafusion:parquet 42249603 45781912 0.92
tpch_q12/datafusion:parquet 81567552 83153877 0.98
tpch_q13/datafusion:parquet 200870792 220290631 0.91
tpch_q14/datafusion:parquet 46790420 46094934 1.02
tpch_q15/datafusion:parquet 60932631 63724390 0.96
tpch_q16/datafusion:parquet 42030224 45764534 0.92
tpch_q17/datafusion:parquet 🚀 130390393 152655310 0.85
tpch_q18/datafusion:parquet 169088323 181527248 0.93
tpch_q19/datafusion:parquet 76848547 72984945 1.05
tpch_q20/datafusion:parquet 71257375 73443848 0.97
tpch_q21/datafusion:parquet 147575954 143954730 1.03
tpch_q22/datafusion:parquet 31932127 33243364 0.96
datafusion / arrow (0.936x ➖, 8↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 51681710 60478618 0.85
tpch_q02/datafusion:arrow 🚀 18711209 21078432 0.89
tpch_q03/datafusion:arrow 🚀 29350925 33552302 0.87
tpch_q04/datafusion:arrow 🚀 24796253 27924928 0.89
tpch_q05/datafusion:arrow 85647291 81553095 1.05
tpch_q06/datafusion:arrow 22222952 21965109 1.01
tpch_q07/datafusion:arrow 116227833 112010598 1.04
tpch_q08/datafusion:arrow 54238508 49796187 1.09
tpch_q09/datafusion:arrow 79823538 77110317 1.04
tpch_q10/datafusion:arrow 51994281 53674840 0.97
tpch_q11/datafusion:arrow 10123537 9889015 1.02
tpch_q12/datafusion:arrow 53538334 56171547 0.95
tpch_q13/datafusion:arrow 47366758 49282296 0.96
tpch_q14/datafusion:arrow 🚀 21037175 24774375 0.85
tpch_q15/datafusion:arrow 🚀 41909835 49705640 0.84
tpch_q16/datafusion:arrow 18649809 20615641 0.90
tpch_q17/datafusion:arrow 74289868 77145575 0.96
tpch_q18/datafusion:arrow 145199996 153540571 0.95
tpch_q19/datafusion:arrow 🚀 35616139 40645316 0.88
tpch_q20/datafusion:arrow 🚀 33609825 42306257 0.79
tpch_q21/datafusion:arrow 154188796 169750638 0.91
tpch_q22/datafusion:arrow 17901272 19041915 0.94
duckdb / vortex-file-compressed (0.990x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31651036 32041906 0.99
tpch_q02/duckdb:vortex-file-compressed 27493895 26918625 1.02
tpch_q03/duckdb:vortex-file-compressed 35882147 35745529 1.00
tpch_q04/duckdb:vortex-file-compressed 29638661 30970203 0.96
tpch_q05/duckdb:vortex-file-compressed 42803697 41650342 1.03
tpch_q06/duckdb:vortex-file-compressed 8807844 9765029 0.90
tpch_q07/duckdb:vortex-file-compressed 36944883 38556452 0.96
tpch_q08/duckdb:vortex-file-compressed 40501977 40471094 1.00
tpch_q09/duckdb:vortex-file-compressed 62853254 63872789 0.98
tpch_q10/duckdb:vortex-file-compressed 45832024 44891256 1.02
tpch_q11/duckdb:vortex-file-compressed 16051882 15606908 1.03
tpch_q12/duckdb:vortex-file-compressed 23464638 24130639 0.97
tpch_q13/duckdb:vortex-file-compressed 44791973 44382235 1.01
tpch_q14/duckdb:vortex-file-compressed 22491892 23131076 0.97
tpch_q15/duckdb:vortex-file-compressed 17186892 18324531 0.94
tpch_q16/duckdb:vortex-file-compressed 33238475 31283780 1.06
tpch_q17/duckdb:vortex-file-compressed 25685205 25474420 1.01
tpch_q18/duckdb:vortex-file-compressed 57735452 56142042 1.03
tpch_q19/duckdb:vortex-file-compressed 32797350 34214177 0.96
tpch_q20/duckdb:vortex-file-compressed 34312419 35782667 0.96
tpch_q21/duckdb:vortex-file-compressed 109547011 113294293 0.97
tpch_q22/duckdb:vortex-file-compressed 19664624 18974940 1.04
duckdb / vortex-compact (1.016x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38789377 39449994 0.98
tpch_q02/duckdb:vortex-compact 34739345 35197306 0.99
tpch_q03/duckdb:vortex-compact 36499496 37260502 0.98
tpch_q04/duckdb:vortex-compact 32868911 32689226 1.01
tpch_q05/duckdb:vortex-compact 47685764 43854100 1.09
tpch_q06/duckdb:vortex-compact 11933466 11713217 1.02
tpch_q07/duckdb:vortex-compact 42014058 43360858 0.97
tpch_q08/duckdb:vortex-compact 47552230 45235423 1.05
tpch_q09/duckdb:vortex-compact 67444416 69991917 0.96
tpch_q10/duckdb:vortex-compact 52244648 48643094 1.07
tpch_q11/duckdb:vortex-compact 19264985 19365943 0.99
tpch_q12/duckdb:vortex-compact 31670656 31026800 1.02
tpch_q13/duckdb:vortex-compact 53479614 49767525 1.07
tpch_q14/duckdb:vortex-compact 27084136 28657643 0.95
tpch_q15/duckdb:vortex-compact 22154296 21963375 1.01
tpch_q16/duckdb:vortex-compact 37025759 35819515 1.03
tpch_q17/duckdb:vortex-compact 30937664 31650770 0.98
tpch_q18/duckdb:vortex-compact 56281394 55453231 1.01
tpch_q19/duckdb:vortex-compact 41059526 37467829 1.10
tpch_q20/duckdb:vortex-compact 41249532 42253662 0.98
tpch_q21/duckdb:vortex-compact 119906281 114236823 1.05
tpch_q22/duckdb:vortex-compact 21750573 20295566 1.07
duckdb / parquet (1.019x ➖, 0↑ 3↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 79534426 77896357 1.02
tpch_q02/duckdb:parquet 42646698 41725896 1.02
tpch_q03/duckdb:parquet 74745489 73429775 1.02
tpch_q04/duckdb:parquet 50623039 52515776 0.96
tpch_q05/duckdb:parquet 72301995 71551283 1.01
tpch_q06/duckdb:parquet 23640914 23154904 1.02
tpch_q07/duckdb:parquet 83760002 87747888 0.95
tpch_q08/duckdb:parquet 93337657 99511168 0.94
tpch_q09/duckdb:parquet 154818089 145526916 1.06
tpch_q10/duckdb:parquet 135358253 133552323 1.01
tpch_q11/duckdb:parquet 23571529 23736936 0.99
tpch_q12/duckdb:parquet 49269738 53520779 0.92
tpch_q13/duckdb:parquet 285110641 276109109 1.03
tpch_q14/duckdb:parquet 55567092 53623847 1.04
tpch_q15/duckdb:parquet 29167311 31616930 0.92
tpch_q16/duckdb:parquet 66412859 61337596 1.08
tpch_q17/duckdb:parquet 56981130 61161600 0.93
tpch_q18/duckdb:parquet 130191252 126105508 1.03
tpch_q19/duckdb:parquet 🚨 89522261 77152202 1.16
tpch_q20/duckdb:parquet 71604816 69450843 1.03
tpch_q21/duckdb:parquet 🚨 210465659 186836753 1.13
tpch_q22/duckdb:parquet 🚨 64823594 55708235 1.16
duckdb / duckdb (1.008x ➖, 0↑ 1↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 18046412 17957384 1.00
tpch_q02/duckdb:duckdb 16696901 15293794 1.09
tpch_q03/duckdb:duckdb 23399501 24170351 0.97
tpch_q04/duckdb:duckdb 23106208 23801372 0.97
tpch_q05/duckdb:duckdb 24409005 25175806 0.97
tpch_q06/duckdb:duckdb 7178419 7479392 0.96
tpch_q07/duckdb:duckdb 26617580 27138177 0.98
tpch_q08/duckdb:duckdb 25723392 25278358 1.02
tpch_q09/duckdb:duckdb 61372772 63276814 0.97
tpch_q10/duckdb:duckdb 52654069 53249919 0.99
tpch_q11/duckdb:duckdb 7737348 7836895 0.99
tpch_q12/duckdb:duckdb 19793026 18917621 1.05
tpch_q13/duckdb:duckdb 42582600 42906645 0.99
tpch_q14/duckdb:duckdb 23359239 23134776 1.01
tpch_q15/duckdb:duckdb 14461885 14275823 1.01
tpch_q16/duckdb:duckdb 27237183 27563654 0.99
tpch_q17/duckdb:duckdb 🚨 19539171 16613387 1.18
tpch_q18/duckdb:duckdb 42905024 42636404 1.01
tpch_q19/duckdb:duckdb 35511386 33402846 1.06
tpch_q20/duckdb:duckdb 25846308 26739127 0.97
tpch_q21/duckdb:duckdb 65497557 65538317 1.00
tpch_q22/duckdb:duckdb 27076441 26283495 1.03
File Size Changes (9 files changed, -2.1% overall, 1↑ 8↓)
File Scale Format Base HEAD Change %
partsupp_0.vortex 1.0 vortex-compact 20.81 MB 20.92 MB +114.99 KB +0.5%
partsupp_0.vortex 1.0 vortex-file-compressed 23.81 MB 23.72 MB 88.00 KB -0.4%
part_0.vortex 1.0 vortex-compact 3.38 MB 3.35 MB 27.87 KB -0.8%
supplier_0.vortex 1.0 vortex-file-compressed 614.33 KB 607.52 KB 6.81 KB -1.1%
customer_0.vortex 1.0 vortex-file-compressed 8.90 MB 8.74 MB 163.95 KB -1.8%
lineitem_1.vortex 1.0 vortex-file-compressed 84.60 MB 82.02 MB 2.58 MB -3.0%
lineitem_0.vortex 1.0 vortex-file-compressed 85.04 MB 82.19 MB 2.84 MB -3.3%
part_0.vortex 1.0 vortex-file-compressed 5.01 MB 4.81 MB 204.07 KB -4.0%
orders_0.vortex 1.0 vortex-file-compressed 38.71 MB 35.39 MB 3.32 MB -8.6%

Totals:

  • vortex-compact: 190.61 MB → 190.70 MB (+0.0%)
  • vortex-file-compressed: 246.94 MB → 237.75 MB (-3.7%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -14.5% +0.9% -15.3% +18.5% ➖ noise
1 datafusion:vortex-compact -3.6% +0.9% -4.5% +20.5% ➖ noise
1 datafusion:vortex-file-compressed +3.7% +0.9% +2.8% +21.2% ➖ noise
1 duckdb:duckdb +0.5% +0.9% -0.4% +16.4% ➖ noise
1 duckdb:vortex-compact -1.7% +0.9% -2.5% +17.3% ➖ noise
1 duckdb:vortex-file-compressed -1.2% +0.9% -2.1% +18.9% ➖ noise
2 datafusion:arrow -11.2% -6.2% -5.4% +13.7% ➖ noise
2 datafusion:vortex-compact -5.3% -6.2% +0.9% +13.7% ➖ noise
2 datafusion:vortex-file-compressed +18.7% -6.2% +26.6% +17.2% 🚨 regression
2 duckdb:duckdb +9.2% -6.2% +16.4% +13.7% 🚨 regression
2 duckdb:vortex-compact -1.3% -6.2% +5.2% +13.7% ➖ noise
2 duckdb:vortex-file-compressed +2.1% -6.2% +8.9% +13.7% ➖ noise
3 datafusion:arrow -12.5% -3.8% -9.1% +13.7% ➖ noise
3 datafusion:vortex-compact +13.6% -3.8% +18.1% +15.1% 🚨 regression
3 datafusion:vortex-file-compressed -5.9% -3.8% -2.2% +15.6% ➖ noise
3 duckdb:duckdb -3.2% -3.8% +0.6% +13.7% ➖ noise
3 duckdb:vortex-compact -2.0% -3.8% +1.8% +13.7% ➖ noise
3 duckdb:vortex-file-compressed +0.4% -3.8% +4.3% +13.7% ➖ noise
4 datafusion:arrow -11.2% -5.7% -5.8% +13.7% ➖ noise
4 datafusion:vortex-compact -8.8% -5.7% -3.3% +13.7% ➖ noise
4 datafusion:vortex-file-compressed -10.0% -5.7% -4.6% +21.5% ➖ noise
4 duckdb:duckdb -2.9% -5.7% +2.9% +13.7% ➖ noise
4 duckdb:vortex-compact +0.5% -5.7% +6.6% +13.7% ➖ noise
4 duckdb:vortex-file-compressed -4.3% -5.7% +1.5% +13.7% ➖ noise
5 datafusion:arrow +5.0% -4.2% +9.6% +13.7% ➖ noise
5 datafusion:vortex-compact +2.3% -4.2% +6.7% +15.0% ➖ noise
5 datafusion:vortex-file-compressed -6.3% -4.2% -2.2% +16.1% ➖ noise
5 duckdb:duckdb -3.0% -4.2% +1.2% +13.7% ➖ noise
5 duckdb:vortex-compact +8.7% -4.2% +13.4% +13.7% ➖ noise
5 duckdb:vortex-file-compressed +2.8% -4.2% +7.2% +13.7% ➖ noise
6 datafusion:arrow +1.2% -2.8% +4.1% +20.8% ➖ noise
6 datafusion:vortex-compact -6.5% -2.8% -3.8% +17.2% ➖ noise
6 datafusion:vortex-file-compressed -3.9% -2.8% -1.2% +22.6% ➖ noise
6 duckdb:duckdb -4.0% -2.8% -1.3% +13.7% ➖ noise
6 duckdb:vortex-compact +1.9% -2.8% +4.8% +18.8% ➖ noise
6 duckdb:vortex-file-compressed -9.8% -2.8% -7.2% +15.7% ➖ noise
7 datafusion:arrow +3.8% -6.2% +10.6% +13.7% ➖ noise
7 datafusion:vortex-compact -8.5% -6.2% -2.5% +13.7% ➖ noise
7 datafusion:vortex-file-compressed -5.8% -6.2% +0.4% +19.3% ➖ noise
7 duckdb:duckdb -1.9% -6.2% +4.6% +13.7% ➖ noise
7 duckdb:vortex-compact -3.1% -6.2% +3.3% +13.7% ➖ noise
7 duckdb:vortex-file-compressed -4.2% -6.2% +2.1% +13.7% ➖ noise
8 datafusion:arrow +8.9% -4.1% +13.6% +13.7% ➖ noise
8 datafusion:vortex-compact -7.8% -4.1% -3.9% +15.5% ➖ noise
8 datafusion:vortex-file-compressed +12.6% -4.1% +17.4% +17.5% ➖ noise
8 duckdb:duckdb +1.8% -4.1% +6.1% +14.7% ➖ noise
8 duckdb:vortex-compact +5.1% -4.1% +9.6% +13.7% ➖ noise
8 duckdb:vortex-file-compressed +0.1% -4.1% +4.4% +13.7% ➖ noise
9 datafusion:arrow +3.5% +0.7% +2.8% +13.7% ➖ noise
9 datafusion:vortex-compact +2.8% +0.7% +2.1% +13.7% ➖ noise
9 datafusion:vortex-file-compressed +4.6% +0.7% +3.9% +16.4% ➖ noise
9 duckdb:duckdb -3.0% +0.7% -3.7% +13.7% ➖ noise
9 duckdb:vortex-compact -3.6% +0.7% -4.3% +13.7% ➖ noise
9 duckdb:vortex-file-compressed -1.6% +0.7% -2.3% +13.7% ➖ noise
10 datafusion:arrow -3.1% -3.4% +0.2% +13.7% ➖ noise
10 datafusion:vortex-compact -6.0% -3.4% -2.8% +13.7% ➖ noise
10 datafusion:vortex-file-compressed -9.0% -3.4% -5.8% +13.7% ➖ noise
10 duckdb:duckdb -1.1% -3.4% +2.3% +13.7% ➖ noise
10 duckdb:vortex-compact +7.4% -3.4% +11.1% +13.7% ➖ noise
10 duckdb:vortex-file-compressed +2.1% -3.4% +5.7% +13.7% ➖ noise
11 datafusion:arrow +2.4% -4.3% +6.9% +13.7% ➖ noise
11 datafusion:vortex-compact +4.7% -4.3% +9.4% +13.7% ➖ noise
11 datafusion:vortex-file-compressed +19.1% -4.3% +24.4% +13.7% 🚨 regression
11 duckdb:duckdb -1.3% -4.3% +3.1% +13.7% ➖ noise
11 duckdb:vortex-compact -0.5% -4.3% +3.9% +15.0% ➖ noise
11 duckdb:vortex-file-compressed +2.9% -4.3% +7.4% +13.7% ➖ noise
12 datafusion:arrow -4.7% -5.0% +0.3% +22.6% ➖ noise
12 datafusion:vortex-compact -2.9% -5.0% +2.2% +14.3% ➖ noise
12 datafusion:vortex-file-compressed -1.5% -5.0% +3.7% +13.7% ➖ noise
12 duckdb:duckdb +4.6% -5.0% +10.1% +13.7% ➖ noise
12 duckdb:vortex-compact +2.1% -5.0% +7.4% +13.7% ➖ noise
12 duckdb:vortex-file-compressed -2.8% -5.0% +2.3% +13.7% ➖ noise
13 datafusion:arrow -3.9% -3.0% -0.9% +13.7% ➖ noise
13 datafusion:vortex-compact -3.8% -3.0% -0.9% +13.7% ➖ noise
13 datafusion:vortex-file-compressed +1.0% -3.0% +4.1% +13.7% ➖ noise
13 duckdb:duckdb -0.8% -3.0% +2.3% +13.7% ➖ noise
13 duckdb:vortex-compact +7.5% -3.0% +10.7% +13.7% ➖ noise
13 duckdb:vortex-file-compressed +0.9% -3.0% +4.0% +13.7% ➖ noise
14 datafusion:arrow -15.1% +2.6% -17.2% +13.7% ✅ faster
14 datafusion:vortex-compact +2.1% +2.6% -0.4% +13.7% ➖ noise
14 datafusion:vortex-file-compressed +0.1% +2.6% -2.4% +13.7% ➖ noise
14 duckdb:duckdb +1.0% +2.6% -1.6% +13.7% ➖ noise
14 duckdb:vortex-compact -5.5% +2.6% -7.9% +13.7% ➖ noise
14 duckdb:vortex-file-compressed -2.8% +2.6% -5.2% +13.7% ➖ noise
15 datafusion:arrow -15.7% -6.1% -10.2% +13.7% ➖ noise
15 datafusion:vortex-compact -5.1% -6.1% +1.1% +13.7% ➖ noise
15 datafusion:vortex-file-compressed +8.8% -6.1% +15.8% +14.9% 🚨 regression
15 duckdb:duckdb +1.3% -6.1% +7.9% +13.7% ➖ noise
15 duckdb:vortex-compact +0.9% -6.1% +7.4% +13.7% ➖ noise
15 duckdb:vortex-file-compressed -6.2% -6.1% -0.1% +14.0% ➖ noise
16 datafusion:arrow -9.5% -0.3% -9.3% +13.7% ➖ noise
16 datafusion:vortex-compact -8.3% -0.3% -8.0% +13.7% ➖ noise
16 datafusion:vortex-file-compressed -1.8% -0.3% -1.5% +13.7% ➖ noise
16 duckdb:duckdb -1.2% -0.3% -0.9% +16.2% ➖ noise
16 duckdb:vortex-compact +3.4% -0.3% +3.7% +13.7% ➖ noise
16 duckdb:vortex-file-compressed +6.2% -0.3% +6.5% +13.7% ➖ noise
17 datafusion:arrow -3.7% -10.8% +8.0% +13.7% ➖ noise
17 datafusion:vortex-compact -3.4% -10.8% +8.3% +13.7% ➖ noise
17 datafusion:vortex-file-compressed +6.5% -10.8% +19.4% +13.7% 🚨 regression
17 duckdb:duckdb +17.6% -10.8% +31.8% +13.7% 🚨 regression
17 duckdb:vortex-compact -2.3% -10.8% +9.6% +13.7% ➖ noise
17 duckdb:vortex-file-compressed +0.8% -10.8% +13.0% +15.2% ➖ noise
18 datafusion:arrow -5.4% -1.9% -3.6% +13.7% ➖ noise
18 datafusion:vortex-compact -8.6% -1.9% -6.8% +13.7% ➖ noise
18 datafusion:vortex-file-compressed -6.7% -1.9% -4.9% +15.1% ➖ noise
18 duckdb:duckdb +0.6% -1.9% +2.6% +13.7% ➖ noise
18 duckdb:vortex-compact +1.5% -1.9% +3.5% +13.7% ➖ noise
18 duckdb:vortex-file-compressed +2.8% -1.9% +4.9% +13.7% ➖ noise
19 datafusion:arrow -12.4% +10.5% -20.7% +16.5% ✅ faster
19 datafusion:vortex-compact -3.4% +10.5% -12.6% +18.0% ➖ noise
19 datafusion:vortex-file-compressed -4.4% +10.5% -13.5% +18.6% ➖ noise
19 duckdb:duckdb +6.3% +10.5% -3.8% +17.4% ➖ noise
19 duckdb:vortex-compact +9.6% +10.5% -0.9% +16.9% ➖ noise
19 duckdb:vortex-file-compressed -4.1% +10.5% -13.3% +13.7% ✅ faster
20 datafusion:arrow -20.6% +0.0% -20.6% +13.7% ✅ faster
20 datafusion:vortex-compact -10.0% +0.0% -10.0% +13.7% ➖ noise
20 datafusion:vortex-file-compressed +3.6% +0.0% +3.6% +17.6% ➖ noise
20 duckdb:duckdb -3.3% +0.0% -3.4% +13.7% ➖ noise
20 duckdb:vortex-compact -2.4% +0.0% -2.4% +13.7% ➖ noise
20 duckdb:vortex-file-compressed -4.1% +0.0% -4.1% +13.7% ➖ noise
21 datafusion:arrow -9.2% +7.5% -15.5% +13.7% ✅ faster
21 datafusion:vortex-compact +1.7% +7.5% -5.3% +13.7% ➖ noise
21 datafusion:vortex-file-compressed -11.0% +7.5% -17.2% +13.7% ✅ faster
21 duckdb:duckdb -0.1% +7.5% -7.0% +13.7% ➖ noise
21 duckdb:vortex-compact +5.0% +7.5% -2.3% +13.7% ➖ noise
21 duckdb:vortex-file-compressed -3.3% +7.5% -10.0% +13.7% ➖ noise
22 datafusion:arrow -6.0% +5.7% -11.1% +13.7% ➖ noise
22 datafusion:vortex-compact -6.8% +5.7% -11.8% +13.7% ➖ noise
22 datafusion:vortex-file-compressed +0.8% +5.7% -4.6% +17.1% ➖ noise
22 duckdb:duckdb +3.0% +5.7% -2.6% +13.7% ➖ noise
22 duckdb:vortex-compact +7.2% +5.7% +1.4% +13.7% ➖ noise
22 duckdb:vortex-file-compressed +3.6% +5.7% -2.0% +14.6% ➖ noise

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Jun 2, 2026 •
edited
Loading

Merging this PR will improve performance by 23.41%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 4 improved benchmarks
✅ 1271 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Simulation baseline_eq[4, 65536] 237.9 µs 185.2 µs +28.49%
⚡ Simulation baseline_lt[16, 65536] 275.5 µs 217.7 µs +26.59%
⚡ Simulation baseline_lt[4, 65536] 253.2 µs 201 µs +25.97%
⚡ Simulation baseline_eq[16, 65536] 260.5 µs 230.1 µs +13.2%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.

Comparing claude/modest-bohr-MHQIy (5ecbcb7) with develop (84a4a3f)

Open in CodSpeed

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (-3.2%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish +1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.024x ➖, 1↑ 5↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 29656281 26983771 1.10
tpcds_q02/datafusion:vortex-file-compressed 49572629 48431688 1.02
tpcds_q03/datafusion:vortex-file-compressed 🚨 17334296 15322160 1.13
tpcds_q04/datafusion:vortex-file-compressed 266290594 259596750 1.03
tpcds_q05/datafusion:vortex-file-compressed 45111601 43357771 1.04
tpcds_q06/datafusion:vortex-file-compressed 58703788 58681172 1.00
tpcds_q07/datafusion:vortex-file-compressed 43869740 42236429 1.04
tpcds_q08/datafusion:vortex-file-compressed 29740161 28593190 1.04
tpcds_q09/datafusion:vortex-file-compressed 41116790 39658529 1.04
tpcds_q10/datafusion:vortex-file-compressed 41628588 38709295 1.08
tpcds_q11/datafusion:vortex-file-compressed 130948705 127676768 1.03
tpcds_q12/datafusion:vortex-file-compressed 20392125 20886155 0.98
tpcds_q13/datafusion:vortex-file-compressed 51900314 48590431 1.07
tpcds_q14/datafusion:vortex-file-compressed 176532910 168615727 1.05
tpcds_q15/datafusion:vortex-file-compressed 29120183 29635935 0.98
tpcds_q16/datafusion:vortex-file-compressed 30369649 28641658 1.06
tpcds_q17/datafusion:vortex-file-compressed 64528800 62875121 1.03
tpcds_q18/datafusion:vortex-file-compressed 72369836 70049245 1.03
tpcds_q19/datafusion:vortex-file-compressed 🚀 22380401 25990953 0.86
tpcds_q20/datafusion:vortex-file-compressed 21399660 20957946 1.02
tpcds_q21/datafusion:vortex-file-compressed 36892607 35279497 1.05
tpcds_q22/datafusion:vortex-file-compressed 144336962 147895607 0.98
tpcds_q23/datafusion:vortex-file-compressed 157346747 157602815 1.00
tpcds_q24/datafusion:vortex-file-compressed 90509394 87371727 1.04
tpcds_q25/datafusion:vortex-file-compressed 68889396 65327941 1.05
tpcds_q26/datafusion:vortex-file-compressed 35984554 33509436 1.07
tpcds_q27/datafusion:vortex-file-compressed 105785713 105963026 1.00
tpcds_q28/datafusion:vortex-file-compressed 34151209 33689684 1.01
tpcds_q29/datafusion:vortex-file-compressed 66098411 62495240 1.06
tpcds_q30/datafusion:vortex-file-compressed 24523971 23636067 1.04
tpcds_q31/datafusion:vortex-file-compressed 74484404 73537640 1.01
tpcds_q32/datafusion:vortex-file-compressed 20529125 19927219 1.03
tpcds_q33/datafusion:vortex-file-compressed 🚨 32504166 29129636 1.12
tpcds_q34/datafusion:vortex-file-compressed 25342229 25087148 1.01
tpcds_q35/datafusion:vortex-file-compressed 46964592 45117154 1.04
tpcds_q36/datafusion:vortex-file-compressed 58531460 58091246 1.01
tpcds_q37/datafusion:vortex-file-compressed 25132221 24248101 1.04
tpcds_q38/datafusion:vortex-file-compressed 44917357 43369018 1.04
tpcds_q39/datafusion:vortex-file-compressed 110198383 113385055 0.97
tpcds_q40/datafusion:vortex-file-compressed 34122447 32502824 1.05
tpcds_q41/datafusion:vortex-file-compressed 🚨 17862549 15573896 1.15
tpcds_q42/datafusion:vortex-file-compressed 14789552 13954864 1.06
tpcds_q43/datafusion:vortex-file-compressed 18959111 19233973 0.99
tpcds_q44/datafusion:vortex-file-compressed 32549767 32778745 0.99
tpcds_q45/datafusion:vortex-file-compressed 29490722 28459914 1.04
tpcds_q46/datafusion:vortex-file-compressed 35689168 35401718 1.01
tpcds_q47/datafusion:vortex-file-compressed 138587546 132104979 1.05
tpcds_q48/datafusion:vortex-file-compressed 37977090 39639146 0.96
tpcds_q49/datafusion:vortex-file-compressed 60240664 58731125 1.03
tpcds_q50/datafusion:vortex-file-compressed 43078725 40067936 1.08
tpcds_q51/datafusion:vortex-file-compressed 90030259 91176259 0.99
tpcds_q52/datafusion:vortex-file-compressed 14460479 16012486 0.90
tpcds_q53/datafusion:vortex-file-compressed 22076982 22187873 1.00
tpcds_q54/datafusion:vortex-file-compressed 35330279 35989549 0.98
tpcds_q55/datafusion:vortex-file-compressed 🚨 15441627 14029766 1.10
tpcds_q56/datafusion:vortex-file-compressed 30128193 30271557 1.00
tpcds_q57/datafusion:vortex-file-compressed 108780881 111784531 0.97
tpcds_q58/datafusion:vortex-file-compressed 54615025 53300417 1.02
tpcds_q59/datafusion:vortex-file-compressed 57124620 56480396 1.01
tpcds_q60/datafusion:vortex-file-compressed 30013475 29930886 1.00
tpcds_q61/datafusion:vortex-file-compressed 41765513 41785736 1.00
tpcds_q62/datafusion:vortex-file-compressed 24968306 26873360 0.93
tpcds_q63/datafusion:vortex-file-compressed 22162341 21768852 1.02
tpcds_q64/datafusion:vortex-file-compressed 427865944 411048378 1.04
tpcds_q65/datafusion:vortex-file-compressed 39677915 39194754 1.01
tpcds_q66/datafusion:vortex-file-compressed 74900238 79446035 0.94
tpcds_q67/datafusion:vortex-file-compressed 147671519 149847228 0.99
tpcds_q68/datafusion:vortex-file-compressed 33048496 34079482 0.97
tpcds_q69/datafusion:vortex-file-compressed 38369192 36262245 1.06
tpcds_q70/datafusion:vortex-file-compressed 88845216 86049339 1.03
tpcds_q71/datafusion:vortex-file-compressed 23890358 24268236 0.98
tpcds_q72/datafusion:vortex-file-compressed 2237074332 2186258279 1.02
tpcds_q73/datafusion:vortex-file-compressed 25035030 23933716 1.05
tpcds_q74/datafusion:vortex-file-compressed 85200766 79226854 1.08
tpcds_q75/datafusion:vortex-file-compressed 111990536 107550943 1.04
tpcds_q76/datafusion:vortex-file-compressed 30978779 30518256 1.02
tpcds_q77/datafusion:vortex-file-compressed 40629569 41776545 0.97
tpcds_q78/datafusion:vortex-file-compressed 128343939 123035626 1.04
tpcds_q79/datafusion:vortex-file-compressed 29016631 28991208 1.00
tpcds_q80/datafusion:vortex-file-compressed 97479036 93389518 1.04
tpcds_q81/datafusion:vortex-file-compressed 24879762 23865578 1.04
tpcds_q82/datafusion:vortex-file-compressed 25165450 24367025 1.03
tpcds_q83/datafusion:vortex-file-compressed 35558666 34431228 1.03
tpcds_q84/datafusion:vortex-file-compressed 13115329 13171458 1.00
tpcds_q85/datafusion:vortex-file-compressed 95173684 93099226 1.02
tpcds_q86/datafusion:vortex-file-compressed 🚨 17487613 15322902 1.14
tpcds_q87/datafusion:vortex-file-compressed 45282670 43321770 1.05
tpcds_q88/datafusion:vortex-file-compressed 58946470 57793411 1.02
tpcds_q89/datafusion:vortex-file-compressed 25520017 24776479 1.03
tpcds_q90/datafusion:vortex-file-compressed 15264224 14305048 1.07
tpcds_q91/datafusion:vortex-file-compressed 19297081 18885960 1.02
tpcds_q92/datafusion:vortex-file-compressed 18063527 18259992 0.99
tpcds_q93/datafusion:vortex-file-compressed 34689291 33416067 1.04
tpcds_q94/datafusion:vortex-file-compressed 24572911 22367907 1.10
tpcds_q95/datafusion:vortex-file-compressed 62700441 64217851 0.98
tpcds_q96/datafusion:vortex-file-compressed 14015957 13553663 1.03
tpcds_q97/datafusion:vortex-file-compressed 33061646 32312476 1.02
tpcds_q98/datafusion:vortex-file-compressed 23891210 23664912 1.01
tpcds_q99/datafusion:vortex-file-compressed 30320667 27905489 1.09
datafusion / vortex-compact (0.976x ➖, 7↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 26598157 25557126 1.04
tpcds_q02/datafusion:vortex-compact 55014792 54179216 1.02
tpcds_q03/datafusion:vortex-compact 20014012 19878408 1.01
tpcds_q04/datafusion:vortex-compact 295697899 306865127 0.96
tpcds_q05/datafusion:vortex-compact 47523840 51190828 0.93
tpcds_q06/datafusion:vortex-compact 62430764 65595502 0.95
tpcds_q07/datafusion:vortex-compact 55575734 52405849 1.06
tpcds_q08/datafusion:vortex-compact 35611634 35642683 1.00
tpcds_q09/datafusion:vortex-compact 50699933 53416700 0.95
tpcds_q10/datafusion:vortex-compact 49473444 49324356 1.00
tpcds_q11/datafusion:vortex-compact 154784494 154341024 1.00
tpcds_q12/datafusion:vortex-compact 23472584 22787836 1.03
tpcds_q13/datafusion:vortex-compact 123896426 125864471 0.98
tpcds_q14/datafusion:vortex-compact 199613057 205446559 0.97
tpcds_q15/datafusion:vortex-compact 31049115 31945894 0.97
tpcds_q16/datafusion:vortex-compact 32944769 33028426 1.00
tpcds_q17/datafusion:vortex-compact 80915634 74644187 1.08
tpcds_q18/datafusion:vortex-compact 80558031 82115920 0.98
tpcds_q19/datafusion:vortex-compact 31418327 30359198 1.03
tpcds_q20/datafusion:vortex-compact 26767000 26940958 0.99
tpcds_q21/datafusion:vortex-compact 38987493 39725240 0.98
tpcds_q22/datafusion:vortex-compact 119488588 126214013 0.95
tpcds_q23/datafusion:vortex-compact 164102034 171798171 0.96
tpcds_q24/datafusion:vortex-compact 99999998 95671530 1.05
tpcds_q25/datafusion:vortex-compact 80773247 82903202 0.97
tpcds_q26/datafusion:vortex-compact 44801279 46152797 0.97
tpcds_q27/datafusion:vortex-compact 122627730 124442893 0.99
tpcds_q28/datafusion:vortex-compact 100525925 100559979 1.00
tpcds_q29/datafusion:vortex-compact 73822303 73864534 1.00
tpcds_q30/datafusion:vortex-compact 28306528 29386744 0.96
tpcds_q31/datafusion:vortex-compact 97590594 100198757 0.97
tpcds_q32/datafusion:vortex-compact 24915838 25937981 0.96
tpcds_q33/datafusion:vortex-compact 36474468 37590050 0.97
tpcds_q34/datafusion:vortex-compact 33349886 35069758 0.95
tpcds_q35/datafusion:vortex-compact 53269095 54273042 0.98
tpcds_q36/datafusion:vortex-compact 73085535 72430030 1.01
tpcds_q37/datafusion:vortex-compact 33629583 34830199 0.97
tpcds_q38/datafusion:vortex-compact 49782840 53292122 0.93
tpcds_q39/datafusion:vortex-compact 119122997 115955592 1.03
tpcds_q40/datafusion:vortex-compact 36927454 37010535 1.00
tpcds_q41/datafusion:vortex-compact 17730883 18302330 0.97
tpcds_q42/datafusion:vortex-compact 18163653 19080335 0.95
tpcds_q43/datafusion:vortex-compact 24957282 25865688 0.96
tpcds_q44/datafusion:vortex-compact 44918748 47751627 0.94
tpcds_q45/datafusion:vortex-compact 30893430 31428671 0.98
tpcds_q46/datafusion:vortex-compact 44797921 47266977 0.95
tpcds_q47/datafusion:vortex-compact 150569901 152141803 0.99
tpcds_q48/datafusion:vortex-compact 90442631 88063001 1.03
tpcds_q49/datafusion:vortex-compact 70872186 72084487 0.98
tpcds_q50/datafusion:vortex-compact 47198897 48127049 0.98
tpcds_q51/datafusion:vortex-compact 94911002 105225213 0.90
tpcds_q52/datafusion:vortex-compact 20743766 18999430 1.09
tpcds_q53/datafusion:vortex-compact 29664115 28859806 1.03
tpcds_q54/datafusion:vortex-compact 42435914 42780489 0.99
tpcds_q55/datafusion:vortex-compact 19018038 18530075 1.03
tpcds_q56/datafusion:vortex-compact 35728086 37624558 0.95
tpcds_q57/datafusion:vortex-compact 120340701 124105335 0.97
tpcds_q58/datafusion:vortex-compact 64155520 66091843 0.97
tpcds_q59/datafusion:vortex-compact 69358816 72978887 0.95
tpcds_q60/datafusion:vortex-compact 37904837 36797184 1.03
tpcds_q61/datafusion:vortex-compact 55364199 56295670 0.98
tpcds_q62/datafusion:vortex-compact 26504698 28768210 0.92
tpcds_q63/datafusion:vortex-compact 28423893 29415092 0.97
tpcds_q64/datafusion:vortex-compact 460524624 468004639 0.98
tpcds_q65/datafusion:vortex-compact 53046425 55707200 0.95
tpcds_q66/datafusion:vortex-compact 76955616 78341095 0.98
tpcds_q67/datafusion:vortex-compact 154172017 157072669 0.98
tpcds_q68/datafusion:vortex-compact 44543182 46887816 0.95
tpcds_q69/datafusion:vortex-compact 46366223 45806483 1.01
tpcds_q70/datafusion:vortex-compact 99255046 93563832 1.06
tpcds_q71/datafusion:vortex-compact 31402135 29450684 1.07
tpcds_q72/datafusion:vortex-compact 2201722374 2262801194 0.97
tpcds_q73/datafusion:vortex-compact 30265698 32065667 0.94
tpcds_q74/datafusion:vortex-compact 🚀 94131952 105052378 0.90
tpcds_q75/datafusion:vortex-compact 131347596 138870202 0.95
tpcds_q76/datafusion:vortex-compact 33398492 32965114 1.01
tpcds_q77/datafusion:vortex-compact 50269534 53865734 0.93
tpcds_q78/datafusion:vortex-compact 139542471 138199034 1.01
tpcds_q79/datafusion:vortex-compact 37627462 39596167 0.95
tpcds_q80/datafusion:vortex-compact 107067452 104043404 1.03
tpcds_q81/datafusion:vortex-compact 29518973 31149144 0.95
tpcds_q82/datafusion:vortex-compact 🚀 34947206 39149648 0.89
tpcds_q83/datafusion:vortex-compact 33938211 35930900 0.94
tpcds_q84/datafusion:vortex-compact 14471137 15505575 0.93
tpcds_q85/datafusion:vortex-compact 171789278 170294067 1.01
tpcds_q86/datafusion:vortex-compact 🚀 20522279 22971714 0.89
tpcds_q87/datafusion:vortex-compact 51523094 54067335 0.95
tpcds_q88/datafusion:vortex-compact 80877799 82221323 0.98
tpcds_q89/datafusion:vortex-compact 32574666 33986491 0.96
tpcds_q90/datafusion:vortex-compact 15534888 16398758 0.95
tpcds_q91/datafusion:vortex-compact 33108953 34843177 0.95
tpcds_q92/datafusion:vortex-compact 🚀 23713376 26963288 0.88
tpcds_q93/datafusion:vortex-compact 🚀 38467825 42854220 0.90
tpcds_q94/datafusion:vortex-compact 29932093 27231914 1.10
tpcds_q95/datafusion:vortex-compact 66841726 72875439 0.92
tpcds_q96/datafusion:vortex-compact 17921970 18299766 0.98
tpcds_q97/datafusion:vortex-compact 36108450 38177777 0.95
tpcds_q98/datafusion:vortex-compact 🚀 29649965 33512298 0.88
tpcds_q99/datafusion:vortex-compact 🚀 32086323 35880866 0.89
datafusion / parquet (1.032x ➖, 0↑ 7↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 33521773 30819135 1.09
tpcds_q02/datafusion:parquet 42384247 41354622 1.02
tpcds_q03/datafusion:parquet 14292490 13122472 1.09
tpcds_q04/datafusion:parquet 271170592 266872493 1.02
tpcds_q05/datafusion:parquet 42230902 41596055 1.02
tpcds_q06/datafusion:parquet 58577476 59504413 0.98
tpcds_q07/datafusion:parquet 80313623 74522326 1.08
tpcds_q08/datafusion:parquet 28097721 27226360 1.03
tpcds_q09/datafusion:parquet 46314511 44002385 1.05
tpcds_q10/datafusion:parquet 70916179 67743020 1.05
tpcds_q11/datafusion:parquet 154621137 150830483 1.03
tpcds_q12/datafusion:parquet 🚨 18312044 15970075 1.15
tpcds_q13/datafusion:parquet 76861613 74758949 1.03
tpcds_q14/datafusion:parquet 167699821 163301404 1.03
tpcds_q15/datafusion:parquet 22632019 21334087 1.06
tpcds_q16/datafusion:parquet 24309574 24219104 1.00
tpcds_q17/datafusion:parquet 65126664 68085542 0.96
tpcds_q18/datafusion:parquet 115975520 114559743 1.01
tpcds_q19/datafusion:parquet 23749365 22999591 1.03
tpcds_q20/datafusion:parquet 🚨 18090892 16110936 1.12
tpcds_q21/datafusion:parquet 19091148 18046555 1.06
tpcds_q22/datafusion:parquet 149524942 143601130 1.04
tpcds_q23/datafusion:parquet 146992342 149850695 0.98
tpcds_q24/datafusion:parquet 94678511 88620596 1.07
tpcds_q25/datafusion:parquet 65335506 67699023 0.97
tpcds_q26/datafusion:parquet 65012362 63538132 1.02
tpcds_q27/datafusion:parquet 146512086 143308204 1.02
tpcds_q28/datafusion:parquet 45675230 44546977 1.03
tpcds_q29/datafusion:parquet 67234038 64628969 1.04
tpcds_q30/datafusion:parquet 35202603 34640829 1.02
tpcds_q31/datafusion:parquet 66182985 63509630 1.04
tpcds_q32/datafusion:parquet 18861970 18289962 1.03
tpcds_q33/datafusion:parquet 🚨 29307210 26290797 1.11
tpcds_q34/datafusion:parquet 23564531 22411160 1.05
tpcds_q35/datafusion:parquet 70385675 67579872 1.04
tpcds_q36/datafusion:parquet 60226647 57713643 1.04
tpcds_q37/datafusion:parquet 18857735 18820097 1.00
tpcds_q38/datafusion:parquet 42442030 44200264 0.96
tpcds_q39/datafusion:parquet 77239474 74767617 1.03
tpcds_q40/datafusion:parquet 23966903 24499101 0.98
tpcds_q41/datafusion:parquet 13600492 13242557 1.03
tpcds_q42/datafusion:parquet 12098287 11420798 1.06
tpcds_q43/datafusion:parquet 17169614 17300135 0.99
tpcds_q44/datafusion:parquet 32972122 35187420 0.94
tpcds_q45/datafusion:parquet 28929335 28712168 1.01
tpcds_q46/datafusion:parquet 33344596 32588765 1.02
tpcds_q47/datafusion:parquet 130022508 126879520 1.02
tpcds_q48/datafusion:parquet 70691549 69379598 1.02
tpcds_q49/datafusion:parquet 56860504 54657225 1.04
tpcds_q50/datafusion:parquet 44762490 43424239 1.03
tpcds_q51/datafusion:parquet 83935412 82583291 1.02
tpcds_q52/datafusion:parquet 11606018 12342698 0.94
tpcds_q53/datafusion:parquet 17676487 17262186 1.02
tpcds_q54/datafusion:parquet 34354918 33725440 1.02
tpcds_q55/datafusion:parquet 12031389 11314079 1.06
tpcds_q56/datafusion:parquet 27938957 26870732 1.04
tpcds_q57/datafusion:parquet 97860312 95464991 1.03
tpcds_q58/datafusion:parquet 52291041 49423399 1.06
tpcds_q59/datafusion:parquet 58420244 58813721 0.99
tpcds_q60/datafusion:parquet 28367092 28503776 1.00
tpcds_q61/datafusion:parquet 44492840 41622270 1.07
tpcds_q62/datafusion:parquet 25535936 24825204 1.03
tpcds_q63/datafusion:parquet 17958892 17891865 1.00
tpcds_q64/datafusion:parquet 527676361 516496695 1.02
tpcds_q65/datafusion:parquet 38921272 37353006 1.04
tpcds_q66/datafusion:parquet 71434444 70294132 1.02
tpcds_q67/datafusion:parquet 148516505 147908359 1.00
tpcds_q68/datafusion:parquet 31871558 32276291 0.99
tpcds_q69/datafusion:parquet 64676211 63711318 1.02
tpcds_q70/datafusion:parquet 84376525 86514544 0.98
tpcds_q71/datafusion:parquet 22747222 21786181 1.04
tpcds_q72/datafusion:parquet 634853455 609883016 1.04
tpcds_q73/datafusion:parquet 22326400 20479077 1.09
tpcds_q74/datafusion:parquet 84331691 88373698 0.95
tpcds_q75/datafusion:parquet 101938691 98122831 1.04
tpcds_q76/datafusion:parquet 30779419 31060428 0.99
tpcds_q77/datafusion:parquet 40072208 41825917 0.96
tpcds_q78/datafusion:parquet 117193744 112918002 1.04
tpcds_q79/datafusion:parquet 26227309 26700438 0.98
tpcds_q80/datafusion:parquet 82641951 81104695 1.02
tpcds_q81/datafusion:parquet 32868708 31829032 1.03
tpcds_q82/datafusion:parquet 19778334 19335674 1.02
tpcds_q83/datafusion:parquet 38763840 36315554 1.07
tpcds_q84/datafusion:parquet 40758232 38863954 1.05
tpcds_q85/datafusion:parquet 151866160 149678804 1.01
tpcds_q86/datafusion:parquet 16283353 15758465 1.03
tpcds_q87/datafusion:parquet 43833678 41321090 1.06
tpcds_q88/datafusion:parquet 60158705 58327985 1.03
tpcds_q89/datafusion:parquet 22423242 20740806 1.08
tpcds_q90/datafusion:parquet 🚨 15244849 13327655 1.14
tpcds_q91/datafusion:parquet 60761079 57195479 1.06
tpcds_q92/datafusion:parquet 18864600 17641333 1.07
tpcds_q93/datafusion:parquet 33080951 33696086 0.98
tpcds_q94/datafusion:parquet 🚨 21291900 18456339 1.15
tpcds_q95/datafusion:parquet 60797752 59492638 1.02
tpcds_q96/datafusion:parquet 🚨 13262042 11620681 1.14
tpcds_q97/datafusion:parquet 30575968 32111974 0.95
tpcds_q98/datafusion:parquet 21692522 21248646 1.02
tpcds_q99/datafusion:parquet 🚨 33876579 25308078 1.34
duckdb / vortex-file-compressed (0.986x ➖, 4↑ 2↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24521541 25076830 0.98
tpcds_q02/duckdb:vortex-file-compressed 35708004 35071382 1.02
tpcds_q03/duckdb:vortex-file-compressed 22774765 23219025 0.98
tpcds_q04/duckdb:vortex-file-compressed 90455932 96088708 0.94
tpcds_q05/duckdb:vortex-file-compressed 35342906 32458548 1.09
tpcds_q06/duckdb:vortex-file-compressed 33749842 33200070 1.02
tpcds_q07/duckdb:vortex-file-compressed 22099495 22287514 0.99
tpcds_q08/duckdb:vortex-file-compressed 28829253 27835154 1.04
tpcds_q09/duckdb:vortex-file-compressed 15360144 15725147 0.98
tpcds_q10/duckdb:vortex-file-compressed 38075898 36931221 1.03
tpcds_q11/duckdb:vortex-file-compressed 64842183 64647993 1.00
tpcds_q12/duckdb:vortex-file-compressed 17002341 16186325 1.05
tpcds_q13/duckdb:vortex-file-compressed 32873973 32127233 1.02
tpcds_q14/duckdb:vortex-file-compressed 96744910 98058033 0.99
tpcds_q15/duckdb:vortex-file-compressed 27758468 27004598 1.03
tpcds_q16/duckdb:vortex-file-compressed 26087147 27281632 0.96
tpcds_q17/duckdb:vortex-file-compressed 46334805 45229729 1.02
tpcds_q18/duckdb:vortex-file-compressed 38981877 36460288 1.07
tpcds_q19/duckdb:vortex-file-compressed 32731440 32727625 1.00
tpcds_q20/duckdb:vortex-file-compressed 17408433 17159664 1.01
tpcds_q21/duckdb:vortex-file-compressed 16694438 16665252 1.00
tpcds_q22/duckdb:vortex-file-compressed 72214855 76708177 0.94
tpcds_q23/duckdb:vortex-file-compressed 100567193 94242672 1.07
tpcds_q24/duckdb:vortex-file-compressed 48562511 48049053 1.01
tpcds_q25/duckdb:vortex-file-compressed 42194905 41741127 1.01
tpcds_q26/duckdb:vortex-file-compressed 19577830 20139418 0.97
tpcds_q27/duckdb:vortex-file-compressed 22681666 23401548 0.97
tpcds_q28/duckdb:vortex-file-compressed 12706739 12496629 1.02
tpcds_q29/duckdb:vortex-file-compressed 41338090 40183601 1.03
tpcds_q30/duckdb:vortex-file-compressed 26246458 26529076 0.99
tpcds_q31/duckdb:vortex-file-compressed 29769787 29384500 1.01
tpcds_q32/duckdb:vortex-file-compressed 13929548 13373458 1.04
tpcds_q33/duckdb:vortex-file-compressed 24039756 23674070 1.02
tpcds_q34/duckdb:vortex-file-compressed 25229874 24439372 1.03
tpcds_q35/duckdb:vortex-file-compressed 66232107 64481400 1.03
tpcds_q36/duckdb:vortex-file-compressed 25184806 24279570 1.04
tpcds_q37/duckdb:vortex-file-compressed 19810318 19971563 0.99
tpcds_q38/duckdb:vortex-file-compressed 37052239 36140685 1.03
tpcds_q39/duckdb:vortex-file-compressed 35635335 36060528 0.99
tpcds_q40/duckdb:vortex-file-compressed 20967086 21450613 0.98
tpcds_q41/duckdb:vortex-file-compressed 10512112 10413465 1.01
tpcds_q42/duckdb:vortex-file-compressed 13946265 13787855 1.01
tpcds_q43/duckdb:vortex-file-compressed 22087223 21955667 1.01
tpcds_q44/duckdb:vortex-file-compressed 21022900 22186857 0.95
tpcds_q45/duckdb:vortex-file-compressed 31520526 33288986 0.95
tpcds_q46/duckdb:vortex-file-compressed 31011684 32539970 0.95
tpcds_q47/duckdb:vortex-file-compressed 51587515 53853930 0.96
tpcds_q48/duckdb:vortex-file-compressed 28838641 30883093 0.93
tpcds_q49/duckdb:vortex-file-compressed 🚨 38950626 34292921 1.14
tpcds_q50/duckdb:vortex-file-compressed 28047727 26027977 1.08
tpcds_q51/duckdb:vortex-file-compressed 108103876 111856942 0.97
tpcds_q52/duckdb:vortex-file-compressed 14153630 13777074 1.03
tpcds_q53/duckdb:vortex-file-compressed 22447055 22377542 1.00
tpcds_q54/duckdb:vortex-file-compressed 28804133 28737712 1.00
tpcds_q55/duckdb:vortex-file-compressed 12940292 12642969 1.02
tpcds_q56/duckdb:vortex-file-compressed 27236858 25039518 1.09
tpcds_q57/duckdb:vortex-file-compressed 42228708 42480462 0.99
tpcds_q58/duckdb:vortex-file-compressed 30540307 30402448 1.00
tpcds_q59/duckdb:vortex-file-compressed 57493759 56801080 1.01
tpcds_q60/duckdb:vortex-file-compressed 26076640 27991443 0.93
tpcds_q61/duckdb:vortex-file-compressed 30407741 33351670 0.91
tpcds_q62/duckdb:vortex-file-compressed 16241932 17185453 0.95
tpcds_q63/duckdb:vortex-file-compressed 20498535 21454644 0.96
tpcds_q64/duckdb:vortex-file-compressed 96352840 101216573 0.95
tpcds_q65/duckdb:vortex-file-compressed 22120681 23604599 0.94
tpcds_q66/duckdb:vortex-file-compressed 30727114 31029134 0.99
tpcds_q67/duckdb:vortex-file-compressed 144881390 142993092 1.01
tpcds_q68/duckdb:vortex-file-compressed 🚨 34274445 30811343 1.11
tpcds_q69/duckdb:vortex-file-compressed 42167854 41942657 1.01
tpcds_q70/duckdb:vortex-file-compressed 37405207 37870845 0.99
tpcds_q71/duckdb:vortex-file-compressed 20768655 21210637 0.98
tpcds_q72/duckdb:vortex-file-compressed 172732253 176540562 0.98
tpcds_q73/duckdb:vortex-file-compressed 25636581 25170784 1.02
tpcds_q74/duckdb:vortex-file-compressed 44479550 45047443 0.99
tpcds_q75/duckdb:vortex-file-compressed 50669162 52442314 0.97
tpcds_q76/duckdb:vortex-file-compressed 21634912 23139342 0.93
tpcds_q77/duckdb:vortex-file-compressed 24178638 25788638 0.94
tpcds_q78/duckdb:vortex-file-compressed 81751801 84044500 0.97
tpcds_q79/duckdb:vortex-file-compressed 24319753 24336636 1.00
tpcds_q80/duckdb:vortex-file-compressed 47532927 52351187 0.91
tpcds_q81/duckdb:vortex-file-compressed 30769507 30589502 1.01
tpcds_q82/duckdb:vortex-file-compressed 45358878 47621851 0.95
tpcds_q83/duckdb:vortex-file-compressed 30923941 28562817 1.08
tpcds_q84/duckdb:vortex-file-compressed 17634355 18066704 0.98
tpcds_q85/duckdb:vortex-file-compressed 42271676 43820034 0.96
tpcds_q86/duckdb:vortex-file-compressed 17448298 17529561 1.00
tpcds_q87/duckdb:vortex-file-compressed 40709322 42692313 0.95
tpcds_q88/duckdb:vortex-file-compressed 51312348 56853684 0.90
tpcds_q89/duckdb:vortex-file-compressed 22696158 22762847 1.00
tpcds_q90/duckdb:vortex-file-compressed 10703900 11295476 0.95
tpcds_q91/duckdb:vortex-file-compressed 23227238 23771887 0.98
tpcds_q92/duckdb:vortex-file-compressed 🚀 19068127 22415556 0.85
tpcds_q93/duckdb:vortex-file-compressed 29673721 32823947 0.90
tpcds_q94/duckdb:vortex-file-compressed 23476840 25030380 0.94
tpcds_q95/duckdb:vortex-file-compressed 160569088 159044526 1.01
tpcds_q96/duckdb:vortex-file-compressed 🚀 12824472 14629846 0.88
tpcds_q97/duckdb:vortex-file-compressed 🚀 39018561 46342398 0.84
tpcds_q98/duckdb:vortex-file-compressed 🚀 19689138 24381933 0.81
tpcds_q99/duckdb:vortex-file-compressed 23236079 25754360 0.90
duckdb / vortex-compact (0.996x ➖, 4↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 26986996 29393828 0.92
tpcds_q02/duckdb:vortex-compact 🚀 33081907 40954895 0.81
tpcds_q03/duckdb:vortex-compact 48765536 52670687 0.93
tpcds_q04/duckdb:vortex-compact 115077881 117324662 0.98
tpcds_q05/duckdb:vortex-compact 41589256 45662136 0.91
tpcds_q06/duckdb:vortex-compact 🚀 39627910 44503164 0.89
tpcds_q07/duckdb:vortex-compact 🚀 34097876 45020299 0.76
tpcds_q08/duckdb:vortex-compact 40851909 44483807 0.92
tpcds_q09/duckdb:vortex-compact 🚀 18695699 21093114 0.89
tpcds_q10/duckdb:vortex-compact 51933954 57596985 0.90
tpcds_q11/duckdb:vortex-compact 75719803 82560848 0.92
tpcds_q12/duckdb:vortex-compact 22597966 23536824 0.96
tpcds_q13/duckdb:vortex-compact 53972041 56027883 0.96
tpcds_q14/duckdb:vortex-compact 115437091 117906429 0.98
tpcds_q15/duckdb:vortex-compact 30261782 30719533 0.99
tpcds_q16/duckdb:vortex-compact 29362072 27597271 1.06
tpcds_q17/duckdb:vortex-compact 55360301 56074818 0.99
tpcds_q18/duckdb:vortex-compact 50246483 49565515 1.01
tpcds_q19/duckdb:vortex-compact 45033318 44000259 1.02
tpcds_q20/duckdb:vortex-compact 21908888 21196533 1.03
tpcds_q21/duckdb:vortex-compact 18543011 19503303 0.95
tpcds_q22/duckdb:vortex-compact 74204905 78794674 0.94
tpcds_q23/duckdb:vortex-compact 109137729 108178471 1.01
tpcds_q24/duckdb:vortex-compact 59973019 59317305 1.01
tpcds_q25/duckdb:vortex-compact 56856146 53510030 1.06
tpcds_q26/duckdb:vortex-compact 31619525 30561396 1.03
tpcds_q27/duckdb:vortex-compact 36479768 35568279 1.03
tpcds_q28/duckdb:vortex-compact 34170932 33757690 1.01
tpcds_q29/duckdb:vortex-compact 55355600 51949086 1.07
tpcds_q30/duckdb:vortex-compact 30067613 29541703 1.02
tpcds_q31/duckdb:vortex-compact 35283015 36678694 0.96
tpcds_q32/duckdb:vortex-compact 22020673 20291808 1.09
tpcds_q33/duckdb:vortex-compact 33811329 32102361 1.05
tpcds_q34/duckdb:vortex-compact 30815184 30208113 1.02
tpcds_q35/duckdb:vortex-compact 78498125 76416164 1.03
tpcds_q36/duckdb:vortex-compact 36187833 35195073 1.03
tpcds_q37/duckdb:vortex-compact 24371902 23845775 1.02
tpcds_q38/duckdb:vortex-compact 43851159 43672427 1.00
tpcds_q39/duckdb:vortex-compact 38186611 37828944 1.01
tpcds_q40/duckdb:vortex-compact 24385593 23595851 1.03
tpcds_q41/duckdb:vortex-compact 12158699 11662224 1.04
tpcds_q42/duckdb:vortex-compact 19017411 19075619 1.00
tpcds_q43/duckdb:vortex-compact 30760466 32809757 0.94
tpcds_q44/duckdb:vortex-compact 31382565 29647501 1.06
tpcds_q45/duckdb:vortex-compact 37015827 35520690 1.04
tpcds_q46/duckdb:vortex-compact 46008013 45495230 1.01
tpcds_q47/duckdb:vortex-compact 64675762 63167083 1.02
tpcds_q48/duckdb:vortex-compact 45418758 46226971 0.98
tpcds_q49/duckdb:vortex-compact 49802733 48290288 1.03
tpcds_q50/duckdb:vortex-compact 38738712 38922928 1.00
tpcds_q51/duckdb:vortex-compact 110934512 110517978 1.00
tpcds_q52/duckdb:vortex-compact 20083969 20210560 0.99
tpcds_q53/duckdb:vortex-compact 33227919 32443018 1.02
tpcds_q54/duckdb:vortex-compact 36519456 37149494 0.98
tpcds_q55/duckdb:vortex-compact 18943690 18586474 1.02
tpcds_q56/duckdb:vortex-compact 35328757 34019624 1.04
tpcds_q57/duckdb:vortex-compact 44955321 45485605 0.99
tpcds_q58/duckdb:vortex-compact 36849505 35021758 1.05
tpcds_q59/duckdb:vortex-compact 67676378 67871136 1.00
tpcds_q60/duckdb:vortex-compact 35010236 35787344 0.98
tpcds_q61/duckdb:vortex-compact 51781411 52963774 0.98
tpcds_q62/duckdb:vortex-compact 20971939 19672489 1.07
tpcds_q63/duckdb:vortex-compact 33043544 32008585 1.03
tpcds_q64/duckdb:vortex-compact 125870427 129173359 0.97
tpcds_q65/duckdb:vortex-compact 31062297 30985891 1.00
tpcds_q66/duckdb:vortex-compact 34890510 35582368 0.98
tpcds_q67/duckdb:vortex-compact 151129166 152600705 0.99
tpcds_q68/duckdb:vortex-compact 45640430 47133736 0.97
tpcds_q69/duckdb:vortex-compact 55211649 54323044 1.02
tpcds_q70/duckdb:vortex-compact 58967219 58002209 1.02
tpcds_q71/duckdb:vortex-compact 29411419 28386605 1.04
tpcds_q72/duckdb:vortex-compact 187518215 184095348 1.02
tpcds_q73/duckdb:vortex-compact 27849876 28671529 0.97
tpcds_q74/duckdb:vortex-compact 49288168 49524300 1.00
tpcds_q75/duckdb:vortex-compact 62960447 59597338 1.06
tpcds_q76/duckdb:vortex-compact 29621713 29633535 1.00
tpcds_q77/duckdb:vortex-compact 39037067 37095551 1.05
tpcds_q78/duckdb:vortex-compact 87422266 86728654 1.01
tpcds_q79/duckdb:vortex-compact 42958348 40231385 1.07
tpcds_q80/duckdb:vortex-compact 71662919 71606469 1.00
tpcds_q81/duckdb:vortex-compact 33787934 34145780 0.99
tpcds_q82/duckdb:vortex-compact 51249562 49775367 1.03
tpcds_q83/duckdb:vortex-compact 36479982 35214449 1.04
tpcds_q84/duckdb:vortex-compact 21054139 20857087 1.01
tpcds_q85/duckdb:vortex-compact 52341393 51441788 1.02
tpcds_q86/duckdb:vortex-compact 22066518 21360267 1.03
tpcds_q87/duckdb:vortex-compact 46376089 45247629 1.02
tpcds_q88/duckdb:vortex-compact 76770117 76823849 1.00
tpcds_q89/duckdb:vortex-compact 32556097 32863039 0.99
tpcds_q90/duckdb:vortex-compact 11635547 11118982 1.05
tpcds_q91/duckdb:vortex-compact 40825905 43775898 0.93
tpcds_q92/duckdb:vortex-compact 39309888 42741997 0.92
tpcds_q93/duckdb:vortex-compact 33470992 32625684 1.03
tpcds_q94/duckdb:vortex-compact 26933139 27654440 0.97
tpcds_q95/duckdb:vortex-compact 168731711 165113704 1.02
tpcds_q96/duckdb:vortex-compact 16184241 17554135 0.92
tpcds_q97/duckdb:vortex-compact 44123754 41294038 1.07
tpcds_q98/duckdb:vortex-compact 27949318 26874993 1.04
tpcds_q99/duckdb:vortex-compact 27240105 25581252 1.06
duckdb / parquet (0.996x ➖, 0↑ 2↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 31070270 32207302 0.96
tpcds_q02/duckdb:parquet 24395066 24667558 0.99
tpcds_q03/duckdb:parquet 12709924 12949899 0.98
tpcds_q04/duckdb:parquet 170433268 168018946 1.01
tpcds_q05/duckdb:parquet 31164018 32485824 0.96
tpcds_q06/duckdb:parquet 34715739 34369153 1.01
tpcds_q07/duckdb:parquet 24060046 24742336 0.97
tpcds_q08/duckdb:parquet 29552797 30251355 0.98
tpcds_q09/duckdb:parquet 44545178 45468666 0.98
tpcds_q10/duckdb:parquet 37558094 38391005 0.98
tpcds_q11/duckdb:parquet 91836732 95853458 0.96
tpcds_q12/duckdb:parquet 17200504 17054897 1.01
tpcds_q13/duckdb:parquet 35085776 35087705 1.00
tpcds_q14/duckdb:parquet 104060395 102248710 1.02
tpcds_q15/duckdb:parquet 31021769 30957726 1.00
tpcds_q16/duckdb:parquet 22750273 22571349 1.01
tpcds_q17/duckdb:parquet 38792489 38168783 1.02
tpcds_q18/duckdb:parquet 48316075 48735276 0.99
tpcds_q19/duckdb:parquet 31994939 31442784 1.02
tpcds_q20/duckdb:parquet 18819605 18565716 1.01
tpcds_q21/duckdb:parquet 11462066 11839744 0.97
tpcds_q22/duckdb:parquet 67347109 69996433 0.96
tpcds_q23/duckdb:parquet 80864075 80176499 1.01
tpcds_q24/duckdb:parquet 47282950 46615568 1.01
tpcds_q25/duckdb:parquet 36409720 36319057 1.00
tpcds_q26/duckdb:parquet 39837133 40107892 0.99
tpcds_q27/duckdb:parquet 52594624 54481230 0.97
tpcds_q28/duckdb:parquet 42394314 43438319 0.98
tpcds_q29/duckdb:parquet 37603046 37050765 1.01
tpcds_q30/duckdb:parquet 37915761 37860412 1.00
tpcds_q31/duckdb:parquet 26748648 28161037 0.95
tpcds_q32/duckdb:parquet 12771168 12320683 1.04
tpcds_q33/duckdb:parquet 23679049 24356169 0.97
tpcds_q34/duckdb:parquet 23000055 22940012 1.00
tpcds_q35/duckdb:parquet 62243104 60484220 1.03
tpcds_q36/duckdb:parquet 22921672 22979313 1.00
tpcds_q37/duckdb:parquet 14669002 15253924 0.96
tpcds_q38/duckdb:parquet 37065865 36578531 1.01
tpcds_q39/duckdb:parquet 31629523 31582432 1.00
tpcds_q40/duckdb:parquet 19770185 19405822 1.02
tpcds_q41/duckdb:parquet 8792238 9117439 0.96
tpcds_q42/duckdb:parquet 12478117 13168300 0.95
tpcds_q43/duckdb:parquet 17140689 17849692 0.96
tpcds_q44/duckdb:parquet 25725653 26692451 0.96
tpcds_q45/duckdb:parquet 28602363 28483467 1.00
tpcds_q46/duckdb:parquet 47593768 48055979 0.99
tpcds_q47/duckdb:parquet 50652515 49493081 1.02
tpcds_q48/duckdb:parquet 32368848 32369730 1.00
tpcds_q49/duckdb:parquet 29311310 29646706 0.99
tpcds_q50/duckdb:parquet 26648384 26190669 1.02
tpcds_q51/duckdb:parquet 104661792 108081504 0.97
tpcds_q52/duckdb:parquet 🚨 14290478 12738667 1.12
tpcds_q53/duckdb:parquet 19145903 19368592 0.99
tpcds_q54/duckdb:parquet 28792922 29606753 0.97
tpcds_q55/duckdb:parquet 12729404 12194342 1.04
tpcds_q56/duckdb:parquet 23528448 24321596 0.97
tpcds_q57/duckdb:parquet 38489266 38679865 1.00
tpcds_q58/duckdb:parquet 26007046 25860622 1.01
tpcds_q59/duckdb:parquet 36050081 36213406 1.00
tpcds_q60/duckdb:parquet 24867415 25482236 0.98
tpcds_q61/duckdb:parquet 34706668 34324479 1.01
tpcds_q62/duckdb:parquet 12774630 12712619 1.00
tpcds_q63/duckdb:parquet 18023715 17615403 1.02
tpcds_q64/duckdb:parquet 77947200 81075540 0.96
tpcds_q65/duckdb:parquet 23207366 22734254 1.02
tpcds_q66/duckdb:parquet 29502937 30054929 0.98
tpcds_q67/duckdb:parquet 137380084 136354372 1.01
tpcds_q68/duckdb:parquet 38720767 39767014 0.97
tpcds_q69/duckdb:parquet 39122874 38780688 1.01
tpcds_q70/duckdb:parquet 22672568 23205528 0.98
tpcds_q71/duckdb:parquet 22511734 23991598 0.94
tpcds_q72/duckdb:parquet 167968289 167243521 1.00
tpcds_q73/duckdb:parquet 19818868 19985694 0.99
tpcds_q74/duckdb:parquet 127152777 127265369 1.00
tpcds_q75/duckdb:parquet 57083530 54924928 1.04
tpcds_q76/duckdb:parquet 22192068 21993400 1.01
tpcds_q77/duckdb:parquet 25572398 25291974 1.01
tpcds_q78/duckdb:parquet 78128725 78012425 1.00
tpcds_q79/duckdb:parquet 30394430 29970742 1.01
tpcds_q80/duckdb:parquet 45137130 44228010 1.02
tpcds_q81/duckdb:parquet 35335412 35649657 0.99
tpcds_q82/duckdb:parquet 16532342 17297913 0.96
tpcds_q83/duckdb:parquet 18863431 18652463 1.01
tpcds_q84/duckdb:parquet 20770071 20887974 0.99
tpcds_q85/duckdb:parquet 42598800 42660135 1.00
tpcds_q86/duckdb:parquet 14027505 13719185 1.02
tpcds_q87/duckdb:parquet 39178727 39564549 0.99
tpcds_q88/duckdb:parquet 53763853 54297759 0.99
tpcds_q89/duckdb:parquet 22251753 22113848 1.01
tpcds_q90/duckdb:parquet 8626806 9361708 0.92
tpcds_q91/duckdb:parquet 26183467 25514030 1.03
tpcds_q92/duckdb:parquet 13617629 13352306 1.02
tpcds_q93/duckdb:parquet 32656429 32181626 1.01
tpcds_q94/duckdb:parquet 18297902 18148547 1.01
tpcds_q95/duckdb:parquet 🚨 149364713 126141278 1.18
tpcds_q96/duckdb:parquet 10629832 11263688 0.94
tpcds_q97/duckdb:parquet 38074068 39518880 0.96
tpcds_q98/duckdb:parquet 24989292 25991415 0.96
tpcds_q99/duckdb:parquet 20456952 21046755 0.97
duckdb / duckdb (1.022x ➖, 0↑ 1↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22427315 21858523 1.03
tpcds_q02/duckdb:duckdb 19775847 19029585 1.04
tpcds_q03/duckdb:duckdb 10550767 10396411 1.01
tpcds_q04/duckdb:duckdb 181621802 180687479 1.01
tpcds_q05/duckdb:duckdb 21073561 20887663 1.01
tpcds_q06/duckdb:duckdb 30092371 28788024 1.05
tpcds_q07/duckdb:duckdb 41376573 40372955 1.02
tpcds_q08/duckdb:duckdb 121407807 120399654 1.01
tpcds_q09/duckdb:duckdb 20999447 20754593 1.01
tpcds_q10/duckdb:duckdb 29060152 27040057 1.07
tpcds_q11/duckdb:duckdb 96903096 94947662 1.02
tpcds_q12/duckdb:duckdb 14635116 13815415 1.06
tpcds_q13/duckdb:duckdb 26215000 26159878 1.00
tpcds_q14/duckdb:duckdb 95520079 93977222 1.02
tpcds_q15/duckdb:duckdb 25558515 25614937 1.00
tpcds_q16/duckdb:duckdb 19977337 19190449 1.04
tpcds_q17/duckdb:duckdb 24579852 24331130 1.01
tpcds_q18/duckdb:duckdb 48057304 48547990 0.99
tpcds_q19/duckdb:duckdb 19366102 19300369 1.00
tpcds_q20/duckdb:duckdb 14681842 14252322 1.03
tpcds_q21/duckdb:duckdb 7953192 7727015 1.03
tpcds_q22/duckdb:duckdb 65955878 61853120 1.07
tpcds_q23/duckdb:duckdb 81334414 76419001 1.06
tpcds_q24/duckdb:duckdb 25606698 25286153 1.01
tpcds_q25/duckdb:duckdb 20010882 19033952 1.05
tpcds_q26/duckdb:duckdb 29611722 28936326 1.02
tpcds_q27/duckdb:duckdb 42892978 42134635 1.02
tpcds_q28/duckdb:duckdb 26045438 26206808 0.99
tpcds_q29/duckdb:duckdb 24359913 23507865 1.04
tpcds_q30/duckdb:duckdb 31613255 31371197 1.01
tpcds_q31/duckdb:duckdb 52826423 51872227 1.02
tpcds_q32/duckdb:duckdb 8446339 8366753 1.01
tpcds_q33/duckdb:duckdb 17359965 16260145 1.07
tpcds_q34/duckdb:duckdb 19029297 18419008 1.03
tpcds_q35/duckdb:duckdb 39652048 37451469 1.06
tpcds_q36/duckdb:duckdb 73606484 72119963 1.02
tpcds_q37/duckdb:duckdb 9155557 8954827 1.02
tpcds_q38/duckdb:duckdb 33811288 33309895 1.02
tpcds_q39/duckdb:duckdb 29714265 28602310 1.04
tpcds_q40/duckdb:duckdb 15420747 14990829 1.03
tpcds_q41/duckdb:duckdb 9924638 9563830 1.04
tpcds_q42/duckdb:duckdb 9633356 9618141 1.00
tpcds_q43/duckdb:duckdb 15122378 14645075 1.03
tpcds_q44/duckdb:duckdb 14999352 15769617 0.95
tpcds_q45/duckdb:duckdb 19124529 19025464 1.01
tpcds_q46/duckdb:duckdb 39933092 39149039 1.02
tpcds_q47/duckdb:duckdb 47349743 47379918 1.00
tpcds_q48/duckdb:duckdb 25441157 25253201 1.01
tpcds_q49/duckdb:duckdb 20782336 21616044 0.96
tpcds_q50/duckdb:duckdb 16458581 16319974 1.01
tpcds_q51/duckdb:duckdb 100438041 99441252 1.01
tpcds_q52/duckdb:duckdb 8925024 9092164 0.98
tpcds_q53/duckdb:duckdb 18023766 18326819 0.98
tpcds_q54/duckdb:duckdb 19525010 18928264 1.03
tpcds_q55/duckdb:duckdb 9341729 9039593 1.03
tpcds_q56/duckdb:duckdb 17178999 16548335 1.04
tpcds_q57/duckdb:duckdb 36780798 36852789 1.00
tpcds_q58/duckdb:duckdb 17321152 16633371 1.04
tpcds_q59/duckdb:duckdb 37102223 37050998 1.00
tpcds_q60/duckdb:duckdb 19124843 19201748 1.00
tpcds_q61/duckdb:duckdb 17502786 17222705 1.02
tpcds_q62/duckdb:duckdb 10092649 10758386 0.94
tpcds_q63/duckdb:duckdb 16276572 17207810 0.95
tpcds_q64/duckdb:duckdb 58829093 59591027 0.99
tpcds_q65/duckdb:duckdb 36941532 38158168 0.97
tpcds_q66/duckdb:duckdb 27973261 27830033 1.01
tpcds_q67/duckdb:duckdb 133944256 132857749 1.01
tpcds_q68/duckdb:duckdb 27271774 27770564 0.98
tpcds_q69/duckdb:duckdb 29564108 28080215 1.05
tpcds_q70/duckdb:duckdb 🚨 17980054 16264046 1.11
tpcds_q71/duckdb:duckdb 17091428 16903611 1.01
tpcds_q72/duckdb:duckdb 47101795 46290907 1.02
tpcds_q73/duckdb:duckdb 14475406 14171948 1.02
tpcds_q74/duckdb:duckdb 147652417 145161241 1.02
tpcds_q75/duckdb:duckdb 47653888 46029714 1.04
tpcds_q76/duckdb:duckdb 15204757 14555192 1.04
tpcds_q77/duckdb:duckdb 16367325 15224384 1.08
tpcds_q78/duckdb:duckdb 66458238 66656263 1.00
tpcds_q79/duckdb:duckdb 20984969 20570704 1.02
tpcds_q80/duckdb:duckdb 34607555 31684328 1.09
tpcds_q81/duckdb:duckdb 40431595 39555489 1.02
tpcds_q82/duckdb:duckdb 11173372 10499779 1.06
tpcds_q83/duckdb:duckdb 11485955 11669801 0.98
tpcds_q84/duckdb:duckdb 15582360 14936059 1.04
tpcds_q85/duckdb:duckdb 26931502 26367463 1.02
tpcds_q86/duckdb:duckdb 12723903 12044916 1.06
tpcds_q87/duckdb:duckdb 36648069 36141826 1.01
tpcds_q88/duckdb:duckdb 31030315 29469287 1.05
tpcds_q89/duckdb:duckdb 22162990 21126822 1.05
tpcds_q90/duckdb:duckdb 6632952 6307607 1.05
tpcds_q91/duckdb:duckdb 15500152 15235368 1.02
tpcds_q92/duckdb:duckdb 10369563 10015621 1.04
tpcds_q93/duckdb:duckdb 25289373 23729613 1.07
tpcds_q94/duckdb:duckdb 15107518 14835969 1.02
tpcds_q95/duckdb:duckdb 117025119 112554908 1.04
tpcds_q96/duckdb:duckdb 6382850 6014010 1.06
tpcds_q97/duckdb:duckdb 33389545 32217513 1.04
tpcds_q98/duckdb:duckdb 22042225 21299585 1.03
tpcds_q99/duckdb:duckdb 17422355 17419091 1.00
File Size Changes (15 files changed, -0.4% overall, 4↑ 11↓)
File Scale Format Base HEAD Change %
customer_address.vortex 1.0 vortex-file-compressed 826.05 KB 829.91 KB +3.87 KB +0.5%
catalog_page.vortex 1.0 vortex-compact 362.70 KB 363.54 KB +856 B +0.2%
item.vortex 1.0 vortex-compact 994.50 KB 995.23 KB +752 B +0.1%
catalog_sales.vortex 1.0 vortex-compact 59.31 MB 59.32 MB +3.31 KB +0.0%
customer.vortex 1.0 vortex-file-compressed 4.27 MB 4.27 MB 272 B -0.0%
web_sales.vortex 1.0 vortex-file-compressed 34.27 MB 34.20 MB 64.74 KB -0.2%
catalog_sales.vortex 1.0 vortex-file-compressed 70.78 MB 70.45 MB 340.13 KB -0.5%
date_dim.vortex 1.0 vortex-file-compressed 1.03 MB 1.02 MB 7.45 KB -0.7%
store_sales.vortex 1.0 vortex-file-compressed 97.04 MB 96.34 MB 721.73 KB -0.7%
catalog_page.vortex 1.0 vortex-file-compressed 572.48 KB 566.76 KB 5.73 KB -1.0%
time_dim.vortex 1.0 vortex-file-compressed 385.07 KB 379.05 KB 6.02 KB -1.6%
date_dim.vortex 1.0 vortex-compact 154.03 KB 151.55 KB 2.48 KB -1.6%
item.vortex 1.0 vortex-file-compressed 1.66 MB 1.63 MB 32.84 KB -1.9%
catalog_returns.vortex 1.0 vortex-file-compressed 7.43 MB 7.16 MB 273.66 KB -3.6%
store_returns.vortex 1.0 vortex-file-compressed 11.39 MB 10.97 MB 421.59 KB -3.6%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (+0.0%)
  • vortex-file-compressed: 271.85 MB → 270.03 MB (-0.7%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +4.1% +2.4% +1.6% +28.7% ➖ noise
1 datafusion:vortex-file-compressed +9.9% +2.4% +7.3% +21.9% ➖ noise
1 duckdb:duckdb +2.6% +2.4% +0.2% +19.6% ➖ noise
1 duckdb:vortex-compact -8.2% +2.4% -10.4% +26.4% ➖ noise
1 duckdb:vortex-file-compressed -2.2% +2.4% -4.5% +27.1% ➖ noise
2 datafusion:vortex-compact +1.5% +0.7% +0.9% +13.3% ➖ noise
2 datafusion:vortex-file-compressed +2.4% +0.7% +1.7% +10.0% ➖ noise
2 duckdb:duckdb +3.9% +0.7% +3.2% +10.0% ➖ noise
2 duckdb:vortex-compact -19.2% +0.7% -19.8% +23.6% ✅ faster
2 duckdb:vortex-file-compressed +1.8% +0.7% +1.1% +19.8% ➖ noise
3 datafusion:vortex-compact +0.7% +3.4% -2.6% +15.9% ➖ noise
3 datafusion:vortex-file-compressed +13.1% +3.4% +9.4% +12.2% ➖ noise
3 duckdb:duckdb +1.5% +3.4% -1.8% +10.0% ➖ noise
3 duckdb:vortex-compact -7.4% +3.4% -10.5% +10.0% ✅ faster
3 duckdb:vortex-file-compressed -1.9% +3.4% -5.1% +11.0% ➖ noise
4 datafusion:vortex-compact -3.6% +1.5% -5.1% +10.4% ➖ noise
4 datafusion:vortex-file-compressed +2.6% +1.5% +1.0% +10.0% ➖ noise
4 duckdb:duckdb +0.5% +1.5% -1.0% +10.0% ➖ noise
4 duckdb:vortex-compact -1.9% +1.5% -3.4% +12.0% ➖ noise
4 duckdb:vortex-file-compressed -5.9% +1.5% -7.3% +19.0% ➖ noise
5 datafusion:vortex-compact -7.2% -1.3% -5.9% +14.6% ➖ noise
5 datafusion:vortex-file-compressed +4.0% -1.3% +5.4% +28.3% ➖ noise
5 duckdb:duckdb +0.9% -1.3% +2.2% +14.0% ➖ noise
5 duckdb:vortex-compact -8.9% -1.3% -7.7% +13.5% ➖ noise
5 duckdb:vortex-file-compressed +8.9% -1.3% +10.3% +11.1% ➖ noise
6 datafusion:vortex-compact -4.8% -0.3% -4.6% +16.3% ➖ noise
6 datafusion:vortex-file-compressed +0.0% -0.3% +0.3% +13.1% ➖ noise
6 duckdb:duckdb +4.5% -0.3% +4.8% +10.0% ➖ noise
6 duckdb:vortex-compact -11.0% -0.3% -10.7% +10.0% ✅ faster
6 duckdb:vortex-file-compressed +1.7% -0.3% +1.9% +10.0% ➖ noise
7 datafusion:vortex-compact +6.0% +2.4% +3.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +3.9% +2.4% +1.5% +10.0% ➖ noise
7 duckdb:duckdb +2.5% +2.4% +0.1% +10.0% ➖ noise
7 duckdb:vortex-compact -24.3% +2.4% -26.0% +21.8% ✅ faster
7 duckdb:vortex-file-compressed -0.8% +2.4% -3.1% +10.0% ➖ noise
8 datafusion:vortex-compact -0.1% +0.4% -0.5% +10.2% ➖ noise
8 datafusion:vortex-file-compressed +4.0% +0.4% +3.6% +10.0% ➖ noise
8 duckdb:duckdb +0.8% +0.4% +0.4% +10.0% ➖ noise
8 duckdb:vortex-compact -8.2% +0.4% -8.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +3.6% +0.4% +3.2% +33.8% ➖ noise
9 datafusion:vortex-compact -5.1% +1.5% -6.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.7% +1.5% +2.1% +13.2% ➖ noise
9 duckdb:duckdb +1.2% +1.5% -0.4% +10.0% ➖ noise
9 duckdb:vortex-compact -11.4% +1.5% -12.7% +10.0% ✅ faster
9 duckdb:vortex-file-compressed -2.3% +1.5% -3.8% +15.7% ➖ noise
10 datafusion:vortex-compact +0.3% +1.2% -0.9% +13.5% ➖ noise
10 datafusion:vortex-file-compressed +7.5% +1.2% +6.3% +12.3% ➖ noise
10 duckdb:duckdb +7.5% +1.2% +6.2% +10.0% ➖ noise
10 duckdb:vortex-compact -9.8% +1.2% -10.9% +18.5% ➖ noise
10 duckdb:vortex-file-compressed +3.1% +1.2% +1.9% +10.0% ➖ noise
11 datafusion:vortex-compact +0.3% -0.9% +1.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.6% -0.9% +3.5% +10.0% ➖ noise
11 duckdb:duckdb +2.1% -0.9% +3.0% +13.4% ➖ noise
11 duckdb:vortex-compact -8.3% -0.9% -7.5% +10.6% ➖ noise
11 duckdb:vortex-file-compressed +0.3% -0.9% +1.2% +10.0% ➖ noise
12 datafusion:vortex-compact +3.0% +7.5% -4.2% +11.9% ➖ noise
12 datafusion:vortex-file-compressed -2.4% +7.5% -9.2% +44.4% ➖ noise
12 duckdb:duckdb +5.9% +7.5% -1.5% +10.0% ➖ noise
12 duckdb:vortex-compact -4.0% +7.5% -10.7% +11.4% ✅ faster
12 duckdb:vortex-file-compressed +5.0% +7.5% -2.3% +32.9% ➖ noise
13 datafusion:vortex-compact -1.6% +1.4% -2.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +6.8% +1.4% +5.3% +10.9% ➖ noise
13 duckdb:duckdb +0.2% +1.4% -1.2% +10.0% ➖ noise
13 duckdb:vortex-compact -3.7% +1.4% -5.0% +14.3% ➖ noise
13 duckdb:vortex-file-compressed +2.3% +1.4% +0.9% +14.8% ➖ noise
14 datafusion:vortex-compact -2.8% +2.2% -5.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +4.7% +2.2% +2.4% +10.0% ➖ noise
14 duckdb:duckdb +1.6% +2.2% -0.6% +11.6% ➖ noise
14 duckdb:vortex-compact -2.1% +2.2% -4.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.3% +2.2% -3.5% +10.0% ➖ noise
15 datafusion:vortex-compact -2.8% +3.1% -5.7% +17.7% ➖ noise
15 datafusion:vortex-file-compressed -1.7% +3.1% -4.7% +20.0% ➖ noise
15 duckdb:duckdb -0.2% +3.1% -3.2% +10.0% ➖ noise
15 duckdb:vortex-compact -1.5% +3.1% -4.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +2.8% +3.1% -0.3% +22.9% ➖ noise
16 datafusion:vortex-compact -0.3% +0.6% -0.8% +36.5% ➖ noise
16 datafusion:vortex-file-compressed +6.0% +0.6% +5.4% +11.3% ➖ noise
16 duckdb:duckdb +4.1% +0.6% +3.5% +11.4% ➖ noise
16 duckdb:vortex-compact +6.4% +0.6% +5.8% +21.8% ➖ noise
16 duckdb:vortex-file-compressed -4.4% +0.6% -4.9% +11.4% ➖ noise
17 datafusion:vortex-compact +8.4% -1.4% +9.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +2.6% -1.4% +4.1% +10.0% ➖ noise
17 duckdb:duckdb +1.0% -1.4% +2.5% +10.0% ➖ noise
17 duckdb:vortex-compact -1.3% -1.4% +0.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +2.4% -1.4% +3.9% +10.0% ➖ noise
18 datafusion:vortex-compact -1.9% +0.2% -2.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +3.3% +0.2% +3.1% +14.8% ➖ noise
18 duckdb:duckdb -1.0% +0.2% -1.2% +10.0% ➖ noise
18 duckdb:vortex-compact +1.4% +0.2% +1.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +6.9% +0.2% +6.7% +10.0% ➖ noise
19 datafusion:vortex-compact +3.5% +2.5% +1.0% +32.3% ➖ noise
19 datafusion:vortex-file-compressed -13.9% +2.5% -16.0% +15.8% ✅ faster
19 duckdb:duckdb +0.3% +2.5% -2.1% +10.2% ➖ noise
19 duckdb:vortex-compact +2.3% +2.5% -0.2% +10.4% ➖ noise
19 duckdb:vortex-file-compressed +0.0% +2.5% -2.4% +13.7% ➖ noise
20 datafusion:vortex-compact -0.6% +6.7% -6.9% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +2.1% +6.7% -4.3% +10.0% ➖ noise
20 duckdb:duckdb +3.0% +6.7% -3.4% +10.0% ➖ noise
20 duckdb:vortex-compact +3.4% +6.7% -3.1% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +1.4% +6.7% -4.9% +10.0% ➖ noise
21 datafusion:vortex-compact -1.9% +1.2% -3.0% +11.1% ➖ noise
21 datafusion:vortex-file-compressed +4.6% +1.2% +3.3% +10.0% ➖ noise
21 duckdb:duckdb +2.9% +1.2% +1.7% +10.3% ➖ noise
21 duckdb:vortex-compact -4.9% +1.2% -6.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.2% +1.2% -1.0% +10.0% ➖ noise
22 datafusion:vortex-compact -5.3% +0.1% -5.4% +21.2% ➖ noise
22 datafusion:vortex-file-compressed -2.4% +0.1% -2.5% +26.7% ➖ noise
22 duckdb:duckdb +6.6% +0.1% +6.5% +12.4% ➖ noise
22 duckdb:vortex-compact -5.8% +0.1% -5.9% +11.4% ➖ noise
22 duckdb:vortex-file-compressed -5.9% +0.1% -5.9% +11.7% ➖ noise
23 datafusion:vortex-compact -4.5% -0.5% -4.0% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -0.2% -0.5% +0.4% +10.0% ➖ noise
23 duckdb:duckdb +6.4% -0.5% +7.0% +11.1% ➖ noise
23 duckdb:vortex-compact +0.9% -0.5% +1.4% +10.5% ➖ noise
23 duckdb:vortex-file-compressed +6.7% -0.5% +7.3% +16.4% ➖ noise
24 datafusion:vortex-compact +4.5% +4.1% +0.4% +14.7% ➖ noise
24 datafusion:vortex-file-compressed +3.6% +4.1% -0.5% +10.3% ➖ noise
24 duckdb:duckdb +1.3% +4.1% -2.7% +10.0% ➖ noise
24 duckdb:vortex-compact +1.1% +4.1% -2.9% +11.8% ➖ noise
24 duckdb:vortex-file-compressed +1.1% +4.1% -2.9% +10.0% ➖ noise
25 datafusion:vortex-compact -2.6% -1.6% -0.9% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +5.5% -1.6% +7.2% +14.2% ➖ noise
25 duckdb:duckdb +5.1% -1.6% +6.9% +10.0% ➖ noise
25 duckdb:vortex-compact +6.3% -1.6% +8.0% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +1.1% -1.6% +2.8% +29.6% ➖ noise
26 datafusion:vortex-compact -2.9% +0.8% -3.7% +15.8% ➖ noise
26 datafusion:vortex-file-compressed +7.4% +0.8% +6.5% +23.7% ➖ noise
26 duckdb:duckdb +2.3% +0.8% +1.5% +10.0% ➖ noise
26 duckdb:vortex-compact +3.5% +0.8% +2.6% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -2.8% +0.8% -3.6% +10.0% ➖ noise
27 datafusion:vortex-compact -1.5% -0.7% -0.8% +10.5% ➖ noise
27 datafusion:vortex-file-compressed -0.2% -0.7% +0.5% +11.8% ➖ noise
27 duckdb:duckdb +1.8% -0.7% +2.5% +10.0% ➖ noise
27 duckdb:vortex-compact +2.6% -0.7% +3.2% +11.9% ➖ noise
27 duckdb:vortex-file-compressed -3.1% -0.7% -2.4% +10.0% ➖ noise
28 datafusion:vortex-compact -0.0% +0.0% -0.1% +12.9% ➖ noise
28 datafusion:vortex-file-compressed +1.4% +0.0% +1.3% +11.3% ➖ noise
28 duckdb:duckdb -0.6% +0.0% -0.6% +10.0% ➖ noise
28 duckdb:vortex-compact +1.2% +0.0% +1.2% +21.8% ➖ noise
28 duckdb:vortex-file-compressed +1.7% +0.0% +1.6% +13.9% ➖ noise
29 datafusion:vortex-compact -0.1% +2.8% -2.7% +12.2% ➖ noise
29 datafusion:vortex-file-compressed +5.8% +2.8% +2.9% +17.8% ➖ noise
29 duckdb:duckdb +3.6% +2.8% +0.8% +10.8% ➖ noise
29 duckdb:vortex-compact +6.6% +2.8% +3.7% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +2.9% +2.8% +0.1% +10.0% ➖ noise
30 datafusion:vortex-compact -3.7% +0.9% -4.5% +10.0% ➖ noise
30 datafusion:vortex-file-compressed +3.8% +0.9% +2.9% +16.5% ➖ noise
30 duckdb:duckdb +0.8% +0.9% -0.1% +10.0% ➖ noise
30 duckdb:vortex-compact +1.8% +0.9% +0.9% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -1.1% +0.9% -1.9% +29.3% ➖ noise
31 datafusion:vortex-compact -2.6% -0.5% -2.1% +10.5% ➖ noise
31 datafusion:vortex-file-compressed +1.3% -0.5% +1.8% +10.0% ➖ noise
31 duckdb:duckdb +1.8% -0.5% +2.4% +10.0% ➖ noise
31 duckdb:vortex-compact -3.8% -0.5% -3.3% +19.0% ➖ noise
31 duckdb:vortex-file-compressed +1.3% -0.5% +1.8% +11.8% ➖ noise
32 datafusion:vortex-compact -3.9% +3.4% -7.1% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +3.0% +3.4% -0.4% +10.0% ➖ noise
32 duckdb:duckdb +1.0% +3.4% -2.4% +10.0% ➖ noise
32 duckdb:vortex-compact +8.5% +3.4% +5.0% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +4.2% +3.4% +0.7% +10.0% ➖ noise
33 datafusion:vortex-compact -3.0% +4.1% -6.8% +12.9% ➖ noise
33 datafusion:vortex-file-compressed +11.6% +4.1% +7.2% +15.2% ➖ noise
33 duckdb:duckdb +6.8% +4.1% +2.6% +10.0% ➖ noise
33 duckdb:vortex-compact +5.3% +4.1% +1.2% +13.5% ➖ noise
33 duckdb:vortex-file-compressed +1.5% +4.1% -2.5% +10.0% ➖ noise
34 datafusion:vortex-compact -4.9% +2.7% -7.4% +10.2% ➖ noise
34 datafusion:vortex-file-compressed +1.0% +2.7% -1.6% +18.2% ➖ noise
34 duckdb:duckdb +3.3% +2.7% +0.6% +11.8% ➖ noise
34 duckdb:vortex-compact +2.0% +2.7% -0.6% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +3.2% +2.7% +0.5% +10.0% ➖ noise
35 datafusion:vortex-compact -1.8% +3.5% -5.2% +15.4% ➖ noise
35 datafusion:vortex-file-compressed +4.1% +3.5% +0.5% +10.0% ➖ noise
35 duckdb:duckdb +5.9% +3.5% +2.3% +10.0% ➖ noise
35 duckdb:vortex-compact +2.7% +3.5% -0.8% +12.9% ➖ noise
35 duckdb:vortex-file-compressed +2.7% +3.5% -0.8% +11.4% ➖ noise
36 datafusion:vortex-compact +0.9% +2.0% -1.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +0.8% +2.0% -1.2% +11.4% ➖ noise
36 duckdb:duckdb +2.1% +2.0% +0.0% +10.0% ➖ noise
36 duckdb:vortex-compact +2.8% +2.0% +0.8% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +3.7% +2.0% +1.7% +10.0% ➖ noise
37 datafusion:vortex-compact -3.4% -1.8% -1.6% +18.0% ➖ noise
37 datafusion:vortex-file-compressed +3.6% -1.8% +5.6% +10.0% ➖ noise
37 duckdb:duckdb +2.2% -1.8% +4.2% +10.0% ➖ noise
37 duckdb:vortex-compact +2.2% -1.8% +4.1% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -0.8% -1.8% +1.0% +10.0% ➖ noise
38 datafusion:vortex-compact -6.6% -1.4% -5.3% +15.6% ➖ noise
38 datafusion:vortex-file-compressed +3.6% -1.4% +5.0% +21.9% ➖ noise
38 duckdb:duckdb +1.5% -1.4% +2.9% +11.7% ➖ noise
38 duckdb:vortex-compact +0.4% -1.4% +1.8% +11.7% ➖ noise
38 duckdb:vortex-file-compressed +2.5% -1.4% +3.9% +14.0% ➖ noise
39 datafusion:vortex-compact +2.7% +1.7% +1.0% +12.5% ➖ noise
39 datafusion:vortex-file-compressed -2.8% +1.7% -4.4% +11.6% ➖ noise
39 duckdb:duckdb +3.9% +1.7% +2.1% +23.0% ➖ noise
39 duckdb:vortex-compact +0.9% +1.7% -0.8% +14.2% ➖ noise
39 duckdb:vortex-file-compressed -1.2% +1.7% -2.8% +15.7% ➖ noise
40 datafusion:vortex-compact -0.2% -0.2% -0.1% +12.3% ➖ noise
40 datafusion:vortex-file-compressed +5.0% -0.2% +5.2% +10.0% ➖ noise
40 duckdb:duckdb +2.9% -0.2% +3.0% +10.0% ➖ noise
40 duckdb:vortex-compact +3.3% -0.2% +3.5% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -2.3% -0.2% -2.1% +10.0% ➖ noise
41 datafusion:vortex-compact -3.1% -0.5% -2.7% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +14.7% -0.5% +15.3% +28.4% ➖ noise
41 duckdb:duckdb +3.8% -0.5% +4.3% +10.0% ➖ noise
41 duckdb:vortex-compact +4.3% -0.5% +4.8% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +0.9% -0.5% +1.4% +10.0% ➖ noise
42 datafusion:vortex-compact -4.8% +0.2% -5.0% +10.9% ➖ noise
42 datafusion:vortex-file-compressed +6.0% +0.2% +5.8% +10.5% ➖ noise
42 duckdb:duckdb +0.2% +0.2% -0.0% +13.6% ➖ noise
42 duckdb:vortex-compact -0.3% +0.2% -0.5% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +1.1% +0.2% +1.0% +10.6% ➖ noise
43 datafusion:vortex-compact -3.5% -2.4% -1.2% +13.0% ➖ noise
43 datafusion:vortex-file-compressed -1.4% -2.4% +1.0% +10.0% ➖ noise
43 duckdb:duckdb +3.3% -2.4% +5.8% +12.4% ➖ noise
43 duckdb:vortex-compact -6.2% -2.4% -4.0% +30.6% ➖ noise
43 duckdb:vortex-file-compressed +0.6% -2.4% +3.0% +29.3% ➖ noise
44 datafusion:vortex-compact -5.9% -5.0% -1.0% +17.9% ➖ noise
44 datafusion:vortex-file-compressed -0.7% -5.0% +4.5% +15.0% ➖ noise
44 duckdb:duckdb -4.9% -5.0% +0.1% +10.0% ➖ noise
44 duckdb:vortex-compact +5.9% -5.0% +11.4% +10.0% 🚨 regression
44 duckdb:vortex-file-compressed -5.2% -5.0% -0.3% +10.0% ➖ noise
45 datafusion:vortex-compact -1.7% +0.6% -2.3% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +3.6% +0.6% +3.0% +10.0% ➖ noise
45 duckdb:duckdb +0.5% +0.6% -0.1% +10.0% ➖ noise
45 duckdb:vortex-compact +4.2% +0.6% +3.6% +10.0% ➖ noise
45 duckdb:vortex-file-compressed -5.3% +0.6% -5.9% +10.0% ➖ noise
46 datafusion:vortex-compact -5.2% +0.7% -5.9% +10.4% ➖ noise
46 datafusion:vortex-file-compressed +0.8% +0.7% +0.1% +14.6% ➖ noise
46 duckdb:duckdb +2.0% +0.7% +1.3% +10.0% ➖ noise
46 duckdb:vortex-compact +1.1% +0.7% +0.5% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -4.7% +0.7% -5.3% +20.2% ➖ noise
47 datafusion:vortex-compact -1.0% +2.4% -3.4% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +4.9% +2.4% +2.4% +10.0% ➖ noise
47 duckdb:duckdb -0.1% +2.4% -2.4% +10.0% ➖ noise
47 duckdb:vortex-compact +2.4% +2.4% -0.0% +10.3% ➖ noise
47 duckdb:vortex-file-compressed -4.2% +2.4% -6.5% +10.0% ➖ noise
48 datafusion:vortex-compact +2.7% +0.9% +1.7% +17.3% ➖ noise
48 datafusion:vortex-file-compressed -4.2% +0.9% -5.1% +14.6% ➖ noise
48 duckdb:duckdb +0.7% +0.9% -0.2% +12.4% ➖ noise
48 duckdb:vortex-compact -1.7% +0.9% -2.7% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -6.6% +0.9% -7.5% +11.2% ➖ noise
49 datafusion:vortex-compact -1.7% +1.4% -3.1% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +2.6% +1.4% +1.1% +10.0% ➖ noise
49 duckdb:duckdb -3.9% +1.4% -5.2% +10.0% ➖ noise
49 duckdb:vortex-compact +3.1% +1.4% +1.7% +17.1% ➖ noise
49 duckdb:vortex-file-compressed +13.6% +1.4% +12.0% +15.3% ➖ noise
50 datafusion:vortex-compact -1.9% +2.4% -4.2% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +7.5% +2.4% +5.0% +17.5% ➖ noise
50 duckdb:duckdb +0.8% +2.4% -1.5% +10.0% ➖ noise
50 duckdb:vortex-compact -0.5% +2.4% -2.8% +17.6% ➖ noise
50 duckdb:vortex-file-compressed +7.8% +2.4% +5.2% +10.0% ➖ noise
51 datafusion:vortex-compact -9.8% -0.8% -9.1% +11.6% ➖ noise
51 datafusion:vortex-file-compressed -1.3% -0.8% -0.5% +11.6% ➖ noise
51 duckdb:duckdb +1.0% -0.8% +1.8% +10.0% ➖ noise
51 duckdb:vortex-compact +0.4% -0.8% +1.2% +15.3% ➖ noise
51 duckdb:vortex-file-compressed -3.4% -0.8% -2.6% +18.1% ➖ noise
52 datafusion:vortex-compact +9.2% +2.7% +6.3% +27.9% ➖ noise
52 datafusion:vortex-file-compressed -9.7% +2.7% -12.1% +16.0% ➖ noise
52 duckdb:duckdb -1.8% +2.7% -4.4% +17.3% ➖ noise
52 duckdb:vortex-compact -0.6% +2.7% -3.2% +23.1% ➖ noise
52 duckdb:vortex-file-compressed +2.7% +2.7% +0.0% +15.7% ➖ noise
53 datafusion:vortex-compact +2.8% +0.6% +2.2% +10.0% ➖ noise
53 datafusion:vortex-file-compressed -0.5% +0.6% -1.1% +10.0% ➖ noise
53 duckdb:duckdb -1.7% +0.6% -2.2% +10.0% ➖ noise
53 duckdb:vortex-compact +2.4% +0.6% +1.8% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +0.3% +0.6% -0.3% +10.0% ➖ noise
54 datafusion:vortex-compact -0.8% -0.5% -0.3% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -1.8% -0.5% -1.4% +10.0% ➖ noise
54 duckdb:duckdb +3.2% -0.5% +3.6% +10.0% ➖ noise
54 duckdb:vortex-compact -1.7% -0.5% -1.2% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +0.2% -0.5% +0.7% +10.0% ➖ noise
55 datafusion:vortex-compact +2.6% +5.4% -2.6% +12.2% ➖ noise
55 datafusion:vortex-file-compressed +10.1% +5.4% +4.5% +25.8% ➖ noise
55 duckdb:duckdb +3.3% +5.4% -1.9% +17.9% ➖ noise
55 duckdb:vortex-compact +1.9% +5.4% -3.3% +11.4% ➖ noise
55 duckdb:vortex-file-compressed +2.4% +5.4% -2.9% +11.7% ➖ noise
56 datafusion:vortex-compact -5.0% +0.3% -5.3% +16.9% ➖ noise
56 datafusion:vortex-file-compressed -0.5% +0.3% -0.8% +10.0% ➖ noise
56 duckdb:duckdb +3.8% +0.3% +3.5% +10.0% ➖ noise
56 duckdb:vortex-compact +3.8% +0.3% +3.5% +15.9% ➖ noise
56 duckdb:vortex-file-compressed +8.8% +0.3% +8.5% +21.2% ➖ noise
57 datafusion:vortex-compact -3.0% +1.0% -4.0% +10.4% ➖ noise
57 datafusion:vortex-file-compressed -2.7% +1.0% -3.6% +10.0% ➖ noise
57 duckdb:duckdb -0.2% +1.0% -1.2% +12.2% ➖ noise
57 duckdb:vortex-compact -1.2% +1.0% -2.1% +14.8% ➖ noise
57 duckdb:vortex-file-compressed -0.6% +1.0% -1.6% +10.9% ➖ noise
58 datafusion:vortex-compact -2.9% +3.2% -5.9% +10.8% ➖ noise
58 datafusion:vortex-file-compressed +2.5% +3.2% -0.7% +13.6% ➖ noise
58 duckdb:duckdb +4.1% +3.2% +1.0% +10.0% ➖ noise
58 duckdb:vortex-compact +5.2% +3.2% +2.0% +10.0% ➖ noise
58 duckdb:vortex-file-compressed +0.5% +3.2% -2.6% +10.0% ➖ noise
59 datafusion:vortex-compact -5.0% -0.6% -4.4% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +1.1% -0.6% +1.7% +10.0% ➖ noise
59 duckdb:duckdb +0.1% -0.6% +0.7% +10.0% ➖ noise
59 duckdb:vortex-compact -0.3% -0.6% +0.3% +12.2% ➖ noise
59 duckdb:vortex-file-compressed +1.2% -0.6% +1.8% +24.8% ➖ noise
60 datafusion:vortex-compact +3.0% -1.5% +4.5% +24.5% ➖ noise
60 datafusion:vortex-file-compressed +0.3% -1.5% +1.8% +10.0% ➖ noise
60 duckdb:duckdb -0.4% -1.5% +1.1% +10.0% ➖ noise
60 duckdb:vortex-compact -2.2% -1.5% -0.7% +10.5% ➖ noise
60 duckdb:vortex-file-compressed -6.8% -1.5% -5.5% +22.8% ➖ noise
61 datafusion:vortex-compact -1.7% +4.0% -5.4% +16.3% ➖ noise
61 datafusion:vortex-file-compressed -0.0% +4.0% -3.9% +11.2% ➖ noise
61 duckdb:duckdb +1.6% +4.0% -2.2% +10.0% ➖ noise
61 duckdb:vortex-compact -2.2% +4.0% -6.0% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -8.8% +4.0% -12.3% +10.0% ✅ faster
62 datafusion:vortex-compact -7.9% +1.7% -9.4% +25.7% ➖ noise
62 datafusion:vortex-file-compressed -7.1% +1.7% -8.6% +21.6% ➖ noise
62 duckdb:duckdb -6.2% +1.7% -7.7% +13.1% ➖ noise
62 duckdb:vortex-compact +6.6% +1.7% +4.9% +18.8% ➖ noise
62 duckdb:vortex-file-compressed -5.5% +1.7% -7.0% +15.0% ➖ noise
63 datafusion:vortex-compact -3.4% +1.3% -4.6% +14.6% ➖ noise
63 datafusion:vortex-file-compressed +1.8% +1.3% +0.5% +10.0% ➖ noise
63 duckdb:duckdb -5.4% +1.3% -6.7% +10.0% ➖ noise
63 duckdb:vortex-compact +3.2% +1.3% +1.9% +26.5% ➖ noise
63 duckdb:vortex-file-compressed -4.5% +1.3% -5.7% +10.0% ➖ noise
64 datafusion:vortex-compact -1.6% -0.9% -0.7% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +4.1% -0.9% +5.0% +10.0% ➖ noise
64 duckdb:duckdb -1.3% -0.9% -0.4% +10.0% ➖ noise
64 duckdb:vortex-compact -2.6% -0.9% -1.7% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -4.8% -0.9% -3.9% +11.3% ➖ noise
65 datafusion:vortex-compact -4.8% +3.1% -7.7% +20.2% ➖ noise
65 datafusion:vortex-file-compressed +1.2% +3.1% -1.8% +13.5% ➖ noise
65 duckdb:duckdb -3.2% +3.1% -6.1% +11.9% ➖ noise
65 duckdb:vortex-compact +0.2% +3.1% -2.8% +15.2% ➖ noise
65 duckdb:vortex-file-compressed -6.3% +3.1% -9.1% +14.9% ➖ noise
66 datafusion:vortex-compact -1.8% -0.1% -1.6% +10.0% ➖ noise
66 datafusion:vortex-file-compressed -5.7% -0.1% -5.6% +15.6% ➖ noise
66 duckdb:duckdb +0.5% -0.1% +0.6% +10.2% ➖ noise
66 duckdb:vortex-compact -1.9% -0.1% -1.8% +10.4% ➖ noise
66 duckdb:vortex-file-compressed -1.0% -0.1% -0.9% +11.1% ➖ noise
67 datafusion:vortex-compact -1.8% +0.6% -2.4% +10.9% ➖ noise
67 datafusion:vortex-file-compressed -1.5% +0.6% -2.0% +11.9% ➖ noise
67 duckdb:duckdb +0.8% +0.6% +0.2% +10.0% ➖ noise
67 duckdb:vortex-compact -1.0% +0.6% -1.5% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +1.3% +0.6% +0.7% +10.0% ➖ noise
68 datafusion:vortex-compact -5.0% -1.9% -3.1% +10.2% ➖ noise
68 datafusion:vortex-file-compressed -3.0% -1.9% -1.1% +15.5% ➖ noise
68 duckdb:duckdb -1.8% -1.9% +0.2% +15.9% ➖ noise
68 duckdb:vortex-compact -3.2% -1.9% -1.2% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +11.2% -1.9% +13.4% +14.1% ➖ noise
69 datafusion:vortex-compact +1.2% +1.2% +0.0% +21.9% ➖ noise
69 datafusion:vortex-file-compressed +5.8% +1.2% +4.6% +10.0% ➖ noise
69 duckdb:duckdb +5.3% +1.2% +4.0% +10.0% ➖ noise
69 duckdb:vortex-compact +1.6% +1.2% +0.4% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +0.5% +1.2% -0.7% +10.5% ➖ noise
70 datafusion:vortex-compact +6.1% -2.4% +8.7% +17.2% ➖ noise
70 datafusion:vortex-file-compressed +3.2% -2.4% +5.8% +11.7% ➖ noise
70 duckdb:duckdb +10.6% -2.4% +13.3% +12.2% 🚨 regression
70 duckdb:vortex-compact +1.7% -2.4% +4.1% +14.0% ➖ noise
70 duckdb:vortex-file-compressed -1.2% -2.4% +1.2% +11.5% ➖ noise
71 datafusion:vortex-compact +6.6% -1.0% +7.7% +14.1% ➖ noise
71 datafusion:vortex-file-compressed -1.6% -1.0% -0.5% +25.1% ➖ noise
71 duckdb:duckdb +1.1% -1.0% +2.2% +10.7% ➖ noise
71 duckdb:vortex-compact +3.6% -1.0% +4.7% +10.0% ➖ noise
71 duckdb:vortex-file-compressed -2.1% -1.0% -1.1% +10.0% ➖ noise
72 datafusion:vortex-compact -2.7% +2.2% -4.8% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +2.3% +2.2% +0.1% +10.0% ➖ noise
72 duckdb:duckdb +1.8% +2.2% -0.5% +10.0% ➖ noise
72 duckdb:vortex-compact +1.9% +2.2% -0.4% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -2.2% +2.2% -4.3% +10.0% ➖ noise
73 datafusion:vortex-compact -5.6% +4.0% -9.2% +10.0% ✅ faster
73 datafusion:vortex-file-compressed +4.6% +4.0% +0.6% +10.0% ➖ noise
73 duckdb:duckdb +2.1% +4.0% -1.8% +10.0% ➖ noise
73 duckdb:vortex-compact -2.9% +4.0% -6.6% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +1.9% +4.0% -2.0% +10.0% ➖ noise
74 datafusion:vortex-compact -10.4% -2.4% -8.2% +23.7% ➖ noise
74 datafusion:vortex-file-compressed +7.5% -2.4% +10.1% +16.5% ➖ noise
74 duckdb:duckdb +1.7% -2.4% +4.2% +10.0% ➖ noise
74 duckdb:vortex-compact -0.5% -2.4% +1.9% +19.2% ➖ noise
74 duckdb:vortex-file-compressed -1.3% -2.4% +1.1% +19.1% ➖ noise
75 datafusion:vortex-compact -5.4% +3.9% -9.0% +13.9% ➖ noise
75 datafusion:vortex-file-compressed +4.1% +3.9% +0.2% +10.8% ➖ noise
75 duckdb:duckdb +3.5% +3.9% -0.4% +10.0% ➖ noise
75 duckdb:vortex-compact +5.6% +3.9% +1.7% +10.0% ➖ noise
75 duckdb:vortex-file-compressed -3.4% +3.9% -7.0% +10.0% ➖ noise
76 datafusion:vortex-compact +1.3% -0.0% +1.3% +16.0% ➖ noise
76 datafusion:vortex-file-compressed +1.5% -0.0% +1.5% +14.8% ➖ noise
76 duckdb:duckdb +4.5% -0.0% +4.5% +10.0% ➖ noise
76 duckdb:vortex-compact -0.0% -0.0% -0.0% +19.4% ➖ noise
76 duckdb:vortex-file-compressed -6.5% -0.0% -6.5% +11.9% ➖ noise
77 datafusion:vortex-compact -6.7% -1.6% -5.2% +11.0% ➖ noise
77 datafusion:vortex-file-compressed -2.7% -1.6% -1.2% +26.6% ➖ noise
77 duckdb:duckdb +7.5% -1.6% +9.2% +18.5% ➖ noise
77 duckdb:vortex-compact +5.2% -1.6% +6.9% +19.1% ➖ noise
77 duckdb:vortex-file-compressed -6.2% -1.6% -4.7% +28.5% ➖ noise
78 datafusion:vortex-compact +1.0% +2.0% -1.0% +11.3% ➖ noise
78 datafusion:vortex-file-compressed +4.3% +2.0% +2.3% +10.0% ➖ noise
78 duckdb:duckdb -0.3% +2.0% -2.2% +10.0% ➖ noise
78 duckdb:vortex-compact +0.8% +2.0% -1.1% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -2.7% +2.0% -4.6% +10.0% ➖ noise
79 datafusion:vortex-compact -5.0% -0.2% -4.8% +15.2% ➖ noise
79 datafusion:vortex-file-compressed +0.1% -0.2% +0.3% +10.2% ➖ noise
79 duckdb:duckdb +2.0% -0.2% +2.2% +12.8% ➖ noise
79 duckdb:vortex-compact +6.8% -0.2% +7.0% +11.5% ➖ noise
79 duckdb:vortex-file-compressed -0.1% -0.2% +0.1% +10.2% ➖ noise
80 datafusion:vortex-compact +2.9% +2.0% +0.9% +10.8% ➖ noise
80 datafusion:vortex-file-compressed +4.4% +2.0% +2.4% +10.7% ➖ noise
80 duckdb:duckdb +9.2% +2.0% +7.1% +10.0% ➖ noise
80 duckdb:vortex-compact +0.1% +2.0% -1.9% +11.0% ➖ noise
80 duckdb:vortex-file-compressed -9.2% +2.0% -11.0% +11.9% ✅ faster
81 datafusion:vortex-compact -5.2% +1.2% -6.3% +26.3% ➖ noise
81 datafusion:vortex-file-compressed +4.2% +1.2% +3.0% +10.0% ➖ noise
81 duckdb:duckdb +2.2% +1.2% +1.0% +10.0% ➖ noise
81 duckdb:vortex-compact -1.0% +1.2% -2.2% +10.0% ➖ noise
81 duckdb:vortex-file-compressed +0.6% +1.2% -0.6% +16.4% ➖ noise
82 datafusion:vortex-compact -10.7% -1.1% -9.7% +14.6% ➖ noise
82 datafusion:vortex-file-compressed +3.3% -1.1% +4.5% +10.0% ➖ noise
82 duckdb:duckdb +6.4% -1.1% +7.6% +10.0% ➖ noise
82 duckdb:vortex-compact +3.0% -1.1% +4.1% +10.5% ➖ noise
82 duckdb:vortex-file-compressed -4.8% -1.1% -3.7% +10.0% ➖ noise
83 datafusion:vortex-compact -5.5% +3.9% -9.1% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +3.3% +3.9% -0.6% +17.2% ➖ noise
83 duckdb:duckdb -1.6% +3.9% -5.3% +11.0% ➖ noise
83 duckdb:vortex-compact +3.6% +3.9% -0.3% +10.5% ➖ noise
83 duckdb:vortex-file-compressed +8.3% +3.9% +4.2% +15.5% ➖ noise
84 datafusion:vortex-compact -6.7% +2.1% -8.6% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -0.4% +2.1% -2.5% +16.2% ➖ noise
84 duckdb:duckdb +4.3% +2.1% +2.2% +10.0% ➖ noise
84 duckdb:vortex-compact +0.9% +2.1% -1.1% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -2.4% +2.1% -4.4% +10.0% ➖ noise
85 datafusion:vortex-compact +0.9% +0.7% +0.2% +15.4% ➖ noise
85 datafusion:vortex-file-compressed +2.2% +0.7% +1.6% +11.7% ➖ noise
85 duckdb:duckdb +2.1% +0.7% +1.5% +10.0% ➖ noise
85 duckdb:vortex-compact +1.7% +0.7% +1.1% +17.1% ➖ noise
85 duckdb:vortex-file-compressed -3.5% +0.7% -4.2% +10.0% ➖ noise
86 datafusion:vortex-compact -10.7% +2.8% -13.1% +19.7% ➖ noise
86 datafusion:vortex-file-compressed +14.1% +2.8% +11.0% +15.8% ➖ noise
86 duckdb:duckdb +5.6% +2.8% +2.8% +12.8% ➖ noise
86 duckdb:vortex-compact +3.3% +2.8% +0.5% +19.3% ➖ noise
86 duckdb:vortex-file-compressed -0.5% +2.8% -3.2% +13.9% ➖ noise
87 datafusion:vortex-compact -4.7% +2.5% -7.0% +11.2% ➖ noise
87 datafusion:vortex-file-compressed +4.5% +2.5% +2.0% +12.3% ➖ noise
87 duckdb:duckdb +1.4% +2.5% -1.1% +13.0% ➖ noise
87 duckdb:vortex-compact +2.5% +2.5% +0.0% +10.1% ➖ noise
87 duckdb:vortex-file-compressed -4.6% +2.5% -7.0% +15.2% ➖ noise
88 datafusion:vortex-compact -1.6% +1.1% -2.7% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +2.0% +1.1% +0.9% +10.8% ➖ noise
88 duckdb:duckdb +5.3% +1.1% +4.2% +10.0% ➖ noise
88 duckdb:vortex-compact -0.1% +1.1% -1.1% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -9.7% +1.1% -10.7% +10.0% ✅ faster
89 datafusion:vortex-compact -4.2% +4.3% -8.1% +12.4% ➖ noise
89 datafusion:vortex-file-compressed +3.0% +4.3% -1.2% +10.2% ➖ noise
89 duckdb:duckdb +4.9% +4.3% +0.6% +13.3% ➖ noise
89 duckdb:vortex-compact -0.9% +4.3% -5.0% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -0.3% +4.3% -4.4% +10.0% ➖ noise
90 datafusion:vortex-compact -5.3% +2.7% -7.7% +10.0% ➖ noise
90 datafusion:vortex-file-compressed +6.7% +2.7% +3.9% +10.0% ➖ noise
90 duckdb:duckdb +5.2% +2.7% +2.4% +10.0% ➖ noise
90 duckdb:vortex-compact +4.6% +2.7% +1.9% +13.7% ➖ noise
90 duckdb:vortex-file-compressed -5.2% +2.7% -7.7% +10.0% ➖ noise
91 datafusion:vortex-compact -5.0% +4.4% -9.0% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +2.2% +4.4% -2.1% +10.0% ➖ noise
91 duckdb:duckdb +1.7% +4.4% -2.6% +10.0% ➖ noise
91 duckdb:vortex-compact -6.7% +4.4% -10.7% +10.0% ✅ faster
91 duckdb:vortex-file-compressed -2.3% +4.4% -6.4% +10.0% ➖ noise
92 datafusion:vortex-compact -12.1% +4.4% -15.8% +19.3% ➖ noise
92 datafusion:vortex-file-compressed -1.1% +4.4% -5.3% +10.0% ➖ noise
92 duckdb:duckdb +3.5% +4.4% -0.9% +10.0% ➖ noise
92 duckdb:vortex-compact -8.0% +4.4% -11.9% +21.3% ➖ noise
92 duckdb:vortex-file-compressed -14.9% +4.4% -18.5% +28.5% ➖ noise
93 datafusion:vortex-compact -10.2% -0.2% -10.1% +13.9% ➖ noise
93 datafusion:vortex-file-compressed +3.8% -0.2% +4.0% +10.0% ➖ noise
93 duckdb:duckdb +6.6% -0.2% +6.8% +10.0% ➖ noise
93 duckdb:vortex-compact +2.6% -0.2% +2.8% +10.0% ➖ noise
93 duckdb:vortex-file-compressed -9.6% -0.2% -9.4% +10.0% ✅ faster
94 datafusion:vortex-compact +9.9% +7.8% +1.9% +25.0% ➖ noise
94 datafusion:vortex-file-compressed +9.9% +7.8% +1.9% +22.2% ➖ noise
94 duckdb:duckdb +1.8% +7.8% -5.6% +10.0% ➖ noise
94 duckdb:vortex-compact -2.6% +7.8% -9.7% +10.1% ✅ faster
94 duckdb:vortex-file-compressed -6.2% +7.8% -13.0% +32.9% ➖ noise
95 datafusion:vortex-compact -8.3% +10.0% -16.6% +10.0% ✅ faster
95 datafusion:vortex-file-compressed -2.4% +10.0% -11.2% +12.9% ➖ noise
95 duckdb:duckdb +4.0% +10.0% -5.5% +17.7% ➖ noise
95 duckdb:vortex-compact +2.2% +10.0% -7.1% +13.7% ➖ noise
95 duckdb:vortex-file-compressed +1.0% +10.0% -8.2% +17.2% ➖ noise
96 datafusion:vortex-compact -2.1% +3.8% -5.6% +14.3% ➖ noise
96 datafusion:vortex-file-compressed +3.4% +3.8% -0.4% +13.3% ➖ noise
96 duckdb:duckdb +6.1% +3.8% +2.3% +24.6% ➖ noise
96 duckdb:vortex-compact -7.8% +3.8% -11.2% +15.7% ➖ noise
96 duckdb:vortex-file-compressed -12.3% +3.8% -15.5% +16.5% ✅ faster
97 datafusion:vortex-compact -5.4% -4.2% -1.3% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +2.3% -4.2% +6.8% +10.0% ➖ noise
97 duckdb:duckdb +3.6% -4.2% +8.2% +10.0% ➖ noise
97 duckdb:vortex-compact +6.9% -4.2% +11.6% +11.9% ➖ noise
97 duckdb:vortex-file-compressed -15.8% -4.2% -12.1% +10.0% ✅ faster
98 datafusion:vortex-compact -11.5% -0.9% -10.7% +13.2% ➖ noise
98 datafusion:vortex-file-compressed +1.0% -0.9% +1.9% +10.0% ➖ noise
98 duckdb:duckdb +3.5% -0.9% +4.5% +10.0% ➖ noise
98 duckdb:vortex-compact +4.0% -0.9% +5.0% +13.3% ➖ noise
98 duckdb:vortex-file-compressed -19.2% -0.9% -18.5% +11.3% ✅ faster
99 datafusion:vortex-compact -10.6% +14.1% -21.6% +27.0% ✅ faster
99 datafusion:vortex-file-compressed +8.7% +14.1% -4.7% +20.8% ➖ noise
99 duckdb:duckdb +0.0% +14.1% -12.3% +30.6% ➖ noise
99 duckdb:vortex-compact +6.5% +14.1% -6.6% +17.5% ➖ noise
99 duckdb:vortex-file-compressed -9.8% +14.1% -20.9% +27.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.5%
Engines: DataFusion No clear signal (+1.3%, environment too noisy confidence) · DuckDB No clear signal (+12.1%, environment too noisy confidence)
Vortex (geomean): 1.077x ➖
Parquet (geomean): 1.011x ➖
Shifts: Parquet (control) +1.1% · Median polish +3.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.012x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 39006801 30640150 1.27
fineweb_q01/datafusion:vortex-file-compressed 561732642 746158171 0.75
fineweb_q02/datafusion:vortex-file-compressed 679881636 549758831 1.24
fineweb_q03/datafusion:vortex-file-compressed 1172777643 1121845790 1.05
fineweb_q04/datafusion:vortex-file-compressed 1177892651 1186112301 0.99
fineweb_q05/datafusion:vortex-file-compressed 1104098648 1103063471 1.00
fineweb_q06/datafusion:vortex-file-compressed 1224623903 1307123959 0.94
fineweb_q07/datafusion:vortex-file-compressed 1110702013 1200985444 0.92
fineweb_q08/datafusion:vortex-file-compressed 466600150 445273248 1.05
datafusion / vortex-compact (1.030x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 36865421 37359074 0.99
fineweb_q01/datafusion:vortex-compact 619172658 553710854 1.12
fineweb_q02/datafusion:vortex-compact 610019818 541449815 1.13
fineweb_q03/datafusion:vortex-compact 1472869870 1487157447 0.99
fineweb_q04/datafusion:vortex-compact 1675855215 1675576609 1.00
fineweb_q05/datafusion:vortex-compact 1366116517 1394269679 0.98
fineweb_q06/datafusion:vortex-compact 1359800957 1320404870 1.03
fineweb_q07/datafusion:vortex-compact 1264092009 1155787639 1.09
fineweb_q08/datafusion:vortex-compact 365278552 380720507 0.96
datafusion / parquet (1.008x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1279146210 1239165727 1.03
fineweb_q01/datafusion:parquet 1909093007 1716501709 1.11
fineweb_q02/datafusion:parquet 1858062912 2117296247 0.88
fineweb_q03/datafusion:parquet 1942450304 2032588959 0.96
fineweb_q04/datafusion:parquet 1991596354 1890700384 1.05
fineweb_q05/datafusion:parquet 1859019800 2069044092 0.90
fineweb_q06/datafusion:parquet 1963337301 1848388812 1.06
fineweb_q07/datafusion:parquet 1812333507 1824630144 0.99
fineweb_q08/datafusion:parquet 2164809945 1930091900 1.12
duckdb / vortex-file-compressed (1.205x ➖, 0↑ 1↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 86525171 82241325 1.05
fineweb_q01/duckdb:vortex-file-compressed 621806247 518593914 1.20
fineweb_q02/duckdb:vortex-file-compressed 🚨 635817105 454705061 1.40
fineweb_q03/duckdb:vortex-file-compressed 1733860868 1439272732 1.20
fineweb_q04/duckdb:vortex-file-compressed 1750754938 1500151593 1.17
fineweb_q05/duckdb:vortex-file-compressed 1820554156 1415364639 1.29
fineweb_q06/duckdb:vortex-file-compressed 1970020080 1630624080 1.21
fineweb_q07/duckdb:vortex-file-compressed 1820295710 1506586413 1.21
fineweb_q08/duckdb:vortex-file-compressed 707073635 613419434 1.15
duckdb / vortex-compact (1.072x ➖, 0↑ 1↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 83841620 80529072 1.04
fineweb_q01/duckdb:vortex-compact 577169921 661587253 0.87
fineweb_q02/duckdb:vortex-compact 671333152 630182159 1.07
fineweb_q03/duckdb:vortex-compact 1906633569 1726062635 1.10
fineweb_q04/duckdb:vortex-compact 2011093993 1909477166 1.05
fineweb_q05/duckdb:vortex-compact 1839207224 1687073591 1.09
fineweb_q06/duckdb:vortex-compact 1735885603 1792037689 0.97
fineweb_q07/duckdb:vortex-compact 2011189129 1690252363 1.19
fineweb_q08/duckdb:vortex-compact 🚨 624270316 470924643 1.33
duckdb / parquet (1.014x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1110575051 1090395348 1.02
fineweb_q01/duckdb:parquet 1427403921 1338128293 1.07
fineweb_q02/duckdb:parquet 1424832130 1477361322 0.96
fineweb_q03/duckdb:parquet 3761454487 3689099563 1.02
fineweb_q04/duckdb:parquet 2094157562 1912700363 1.09
fineweb_q05/duckdb:parquet 2231065086 2110510754 1.06
fineweb_q06/duckdb:parquet 4318963323 4364520621 0.99
fineweb_q07/duckdb:parquet 2652553978 2614638337 1.01
fineweb_q08/duckdb:parquet 1088565679 1188482584 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -1.3% +2.5% -3.8% +161.7% ➖ noise
0 datafusion:vortex-file-compressed +27.3% +2.5% +24.2% +217.1% ➖ noise
0 duckdb:vortex-compact +4.1% +2.5% +1.5% +60.8% ➖ noise
0 duckdb:vortex-file-compressed +5.2% +2.5% +2.6% +60.9% ➖ noise
1 datafusion:vortex-compact +11.8% +8.9% +2.7% +84.8% ➖ noise
1 datafusion:vortex-file-compressed -24.7% +8.9% -30.9% +80.1% ➖ noise
1 duckdb:vortex-compact -12.8% +8.9% -19.9% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +19.9% +8.9% +10.1% +30.0% ➖ noise
2 datafusion:vortex-compact +12.7% -8.0% +22.5% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +23.7% -8.0% +34.4% +46.4% ➖ noise
2 duckdb:vortex-compact +6.5% -8.0% +15.8% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +39.8% -8.0% +52.0% +37.6% 🚨 regression
3 datafusion:vortex-compact -1.0% -1.3% +0.3% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +4.5% -1.3% +5.9% +39.1% ➖ noise
3 duckdb:vortex-compact +10.5% -1.3% +11.9% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +20.5% -1.3% +22.0% +30.0% ➖ noise
4 datafusion:vortex-compact +0.0% +7.4% -6.9% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.7% +7.4% -7.5% +30.0% ➖ noise
4 duckdb:vortex-compact +5.3% +7.4% -1.9% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +16.7% +7.4% +8.7% +30.0% ➖ noise
5 datafusion:vortex-compact -2.0% -2.5% +0.5% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +0.1% -2.5% +2.7% +30.0% ➖ noise
5 duckdb:vortex-compact +9.0% -2.5% +11.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +28.6% -2.5% +32.0% +30.0% 🚨 regression
6 datafusion:vortex-compact +3.0% +2.5% +0.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -6.3% +2.5% -8.6% +30.0% ➖ noise
6 duckdb:vortex-compact -3.1% +2.5% -5.5% +33.9% ➖ noise
6 duckdb:vortex-file-compressed +20.8% +2.5% +17.8% +30.0% ➖ noise
7 datafusion:vortex-compact +9.4% +0.4% +9.0% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -7.5% +0.4% -7.9% +30.0% ➖ noise
7 duckdb:vortex-compact +19.0% +0.4% +18.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +20.8% +0.4% +20.4% +30.0% ➖ noise
8 datafusion:vortex-compact -4.1% +1.4% -5.3% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +4.8% +1.4% +3.4% +30.0% ➖ noise
8 duckdb:vortex-compact +32.6% +1.4% +30.8% +30.0% 🚨 regression
8 duckdb:vortex-file-compressed +15.3% +1.4% +13.7% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.6%
Engines: DuckDB No clear signal (+4.6%, low confidence)
Vortex (geomean): 1.042x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (1.076x ➖, 0↑ 2↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11673004 12326757 0.95
statpopgen_q01/duckdb:vortex-file-compressed 27123222 28299913 0.96
statpopgen_q02/duckdb:vortex-file-compressed 548481187 533226604 1.03
statpopgen_q03/duckdb:vortex-file-compressed 1083523400 1051154072 1.03
statpopgen_q04/duckdb:vortex-file-compressed 1056878832 1076295843 0.98
statpopgen_q05/duckdb:vortex-file-compressed 478804713 501560630 0.95
statpopgen_q06/duckdb:vortex-file-compressed 1553543222 1544676436 1.01
statpopgen_q07/duckdb:vortex-file-compressed 🚨 325610262 200481252 1.62
statpopgen_q08/duckdb:vortex-file-compressed 🚨 355383093 232966074 1.53
statpopgen_q09/duckdb:vortex-file-compressed 835589779 836783641 1.00
statpopgen_q10/duckdb:vortex-file-compressed 2566232296 2561787657 1.00
duckdb / vortex-compact (1.008x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11796625 11321143 1.04
statpopgen_q01/duckdb:vortex-compact 220070297 214964176 1.02
statpopgen_q02/duckdb:vortex-compact 563412158 561707207 1.00
statpopgen_q03/duckdb:vortex-compact 1146735961 1146531688 1.00
statpopgen_q04/duckdb:vortex-compact 1158845276 1147147673 1.01
statpopgen_q05/duckdb:vortex-compact 565585575 567944885 1.00
statpopgen_q06/duckdb:vortex-compact 1525456440 1494494005 1.02
statpopgen_q07/duckdb:vortex-compact 887451699 888640083 1.00
statpopgen_q08/duckdb:vortex-compact 919698874 922126637 1.00
statpopgen_q09/duckdb:vortex-compact 910483568 911508452 1.00
statpopgen_q10/duckdb:vortex-compact 2598189424 2590199829 1.00
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 294679527 304695704 0.97
statpopgen_q01/duckdb:parquet 377619892 385208649 0.98
statpopgen_q02/duckdb:parquet 752677769 767677453 0.98
statpopgen_q03/duckdb:parquet 1175894137 1187803202 0.99
statpopgen_q04/duckdb:parquet 1186896024 1187816516 1.00
statpopgen_q05/duckdb:parquet 816269016 823578030 0.99
statpopgen_q06/duckdb:parquet 1423863613 1406455171 1.01
statpopgen_q07/duckdb:parquet 885832728 870498931 1.02
statpopgen_q08/duckdb:parquet 867835393 862548012 1.01
statpopgen_q09/duckdb:parquet 1044810578 1024591985 1.02
statpopgen_q10/duckdb:parquet 2205211224 2211270392 1.00
File Size Changes (1 files changed, -4.5% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.83 GB 132.30 MB -6.6%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.83 GB (-6.6%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +4.2% -3.3% +7.7% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -5.3% -3.3% -2.1% +10.5% ➖ noise
1 duckdb:vortex-compact +2.4% -2.0% +4.4% +17.6% ➖ noise
1 duckdb:vortex-file-compressed -4.2% -2.0% -2.2% +216.9% ➖ noise
2 duckdb:vortex-compact +0.3% -2.0% +2.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +2.9% -2.0% +4.9% +10.0% ➖ noise
3 duckdb:vortex-compact +0.0% -1.0% +1.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +3.1% -1.0% +4.1% +10.0% ➖ noise
4 duckdb:vortex-compact +1.0% -0.1% +1.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.8% -0.1% -1.7% +10.0% ➖ noise
5 duckdb:vortex-compact -0.4% -0.9% +0.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.5% -0.9% -3.7% +10.0% ➖ noise
6 duckdb:vortex-compact +2.1% +1.2% +0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.6% +1.2% -0.7% +10.0% ➖ noise
7 duckdb:vortex-compact -0.1% +1.8% -1.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +62.4% +1.8% +59.6% +10.0% 🚨 regression
8 duckdb:vortex-compact -0.3% +0.6% -0.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +52.5% +0.6% +51.6% +10.0% 🚨 regression
9 duckdb:vortex-compact -0.1% +2.0% -2.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.1% +2.0% -2.1% +10.0% ➖ noise
10 duckdb:vortex-compact +0.3% -0.3% +0.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.2% -0.3% +0.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: Random Access

Vortex (geomean): 1.016x ➖
Parquet (geomean): 1.031x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (1.051x ➖, 0↑ 3↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 1668837 376775 4.43
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1080306 1058253 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8339455921 8289797949 1.01
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8318343963 8291364815 1.00
random-access/feature-vectors/correlated/vortex-tokio-local-disk 3876101 4153361 0.93
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 3000509 3001208 1.00
random-access/feature-vectors/uniform/lance-tokio-local-disk 1203337 1153518 1.04
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1893735 1830816 1.03
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8347030254 8163061454 1.02
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8385545450 8262256716 1.01
random-access/feature-vectors/uniform/vortex-tokio-local-disk 6433512 6067824 1.06
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 6133156 5898882 1.04
random-access/lance-tokio-local-disk 634481 630445 1.01
random-access/lance-tokio-local-disk-footer 1310773 1287976 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk 246078 239801 1.03
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 595068 581853 1.02
random-access/nested-lists/correlated/parquet-tokio-local-disk 131405893 127997957 1.03
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 129451537 127798892 1.01
random-access/nested-lists/correlated/vortex-tokio-local-disk 599958 568697 1.05
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 625078 564059 1.11
random-access/nested-lists/uniform/lance-tokio-local-disk 1005598 991275 1.01
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1371177 1336202 1.03
random-access/nested-lists/uniform/parquet-tokio-local-disk 130196939 127698460 1.02
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 129492522 127613640 1.01
random-access/nested-lists/uniform/vortex-tokio-local-disk 2101916 2043936 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2100515 2041976 1.03
random-access/nested-structs/correlated/lance-tokio-local-disk 373857 364904 1.02
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 564242 545154 1.04
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 24106027 21888035 1.10
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 23766231 22126624 1.07
random-access/nested-structs/correlated/vortex-tokio-local-disk 731200 734477 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 734605 740593 0.99
random-access/nested-structs/uniform/lance-tokio-local-disk 2607494 2591373 1.01
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2753116 2713546 1.01
random-access/nested-structs/uniform/parquet-tokio-local-disk 23856642 22351924 1.07
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 24104552 22019411 1.09
random-access/nested-structs/uniform/vortex-tokio-local-disk 1600095 1595938 1.00
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1621094 1541053 1.05
random-access/parquet-tokio-local-disk 169104212 164726603 1.03
random-access/parquet-tokio-local-disk-footer 168588787 166713697 1.01
random-access/taxi/correlated/lance-tokio-local-disk 943974 917488 1.03
random-access/taxi/correlated/lance-tokio-local-disk-footer 1878793 1790874 1.05
random-access/taxi/correlated/parquet-tokio-local-disk 252720612 247651926 1.02
random-access/taxi/correlated/parquet-tokio-local-disk-footer 252425527 248574473 1.02
random-access/taxi/correlated/vortex-tokio-local-disk 1510819 1623249 0.93
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1673276 1636305 1.02
random-access/taxi/uniform/lance-tokio-local-disk 9228429 9212553 1.00
random-access/taxi/uniform/lance-tokio-local-disk-footer 9877126 9744831 1.01
random-access/taxi/uniform/parquet-tokio-local-disk 268478335 263833412 1.02
random-access/taxi/uniform/parquet-tokio-local-disk-footer 268258111 265505583 1.01
random-access/taxi/uniform/vortex-tokio-local-disk 4230276 4080693 1.04
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4203687 4066447 1.03
random-access/vortex-tokio-local-disk 1133386 1142003 0.99
random-access/vortex-tokio-local-disk-footer 1152910 1162546 0.99

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+1.2%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): 0.988x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.984x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 389073290 405335014 0.96
tpch_q02/datafusion:vortex-file-compressed 110343528 114685186 0.96
tpch_q03/datafusion:vortex-file-compressed 213985296 215426803 0.99
tpch_q04/datafusion:vortex-file-compressed 111487459 118851199 0.94
tpch_q05/datafusion:vortex-file-compressed 381838299 387749900 0.98
tpch_q06/datafusion:vortex-file-compressed 38597788 37970389 1.02
tpch_q07/datafusion:vortex-file-compressed 506354484 509417917 0.99
tpch_q08/datafusion:vortex-file-compressed 373083198 374657909 1.00
tpch_q09/datafusion:vortex-file-compressed 646143891 653242417 0.99
tpch_q10/datafusion:vortex-file-compressed 233203474 232777827 1.00
tpch_q11/datafusion:vortex-file-compressed 85432711 87857199 0.97
tpch_q12/datafusion:vortex-file-compressed 120113089 118237349 1.02
tpch_q13/datafusion:vortex-file-compressed 224371905 226138163 0.99
tpch_q14/datafusion:vortex-file-compressed 53254597 52312072 1.02
tpch_q15/datafusion:vortex-file-compressed 99919341 101037866 0.99
tpch_q16/datafusion:vortex-file-compressed 78025208 78205912 1.00
tpch_q17/datafusion:vortex-file-compressed 640286508 654137126 0.98
tpch_q18/datafusion:vortex-file-compressed 866736158 884555155 0.98
tpch_q19/datafusion:vortex-file-compressed 75474069 77887797 0.97
tpch_q20/datafusion:vortex-file-compressed 164616322 167317062 0.98
tpch_q21/datafusion:vortex-file-compressed 653452264 683141984 0.96
tpch_q22/datafusion:vortex-file-compressed 68128742 70343479 0.97
datafusion / vortex-compact (0.988x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 435384835 441191387 0.99
tpch_q02/datafusion:vortex-compact 115534480 116846240 0.99
tpch_q03/datafusion:vortex-compact 215985369 216860462 1.00
tpch_q04/datafusion:vortex-compact 120722541 120482140 1.00
tpch_q05/datafusion:vortex-compact 382021266 385716842 0.99
tpch_q06/datafusion:vortex-compact 60436965 59985181 1.01
tpch_q07/datafusion:vortex-compact 522928218 530574688 0.99
tpch_q08/datafusion:vortex-compact 372954973 379154333 0.98
tpch_q09/datafusion:vortex-compact 650993647 661053251 0.98
tpch_q10/datafusion:vortex-compact 247382654 253144519 0.98
tpch_q11/datafusion:vortex-compact 88503358 89506990 0.99
tpch_q12/datafusion:vortex-compact 160451500 160257147 1.00
tpch_q13/datafusion:vortex-compact 266139831 270190759 0.99
tpch_q14/datafusion:vortex-compact 69697588 70704654 0.99
tpch_q15/datafusion:vortex-compact 154100803 157631363 0.98
tpch_q16/datafusion:vortex-compact 83318062 83354475 1.00
tpch_q17/datafusion:vortex-compact 646135767 655949003 0.99
tpch_q18/datafusion:vortex-compact 869300132 880015939 0.99
tpch_q19/datafusion:vortex-compact 125654766 126748014 0.99
tpch_q20/datafusion:vortex-compact 186421716 192370061 0.97
tpch_q21/datafusion:vortex-compact 684712386 681953069 1.00
tpch_q22/datafusion:vortex-compact 72696712 75775617 0.96
datafusion / parquet (0.996x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 469857638 455388780 1.03
tpch_q02/datafusion:parquet 173751550 175158290 0.99
tpch_q03/datafusion:parquet 283962435 286972236 0.99
tpch_q04/datafusion:parquet 127967676 128124289 1.00
tpch_q05/datafusion:parquet 443531410 449407279 0.99
tpch_q06/datafusion:parquet 129732419 128355948 1.01
tpch_q07/datafusion:parquet 609092227 616504872 0.99
tpch_q08/datafusion:parquet 466473389 473852160 0.98
tpch_q09/datafusion:parquet 752440230 767577122 0.98
tpch_q10/datafusion:parquet 512645772 508270416 1.01
tpch_q11/datafusion:parquet 116247435 118690636 0.98
tpch_q12/datafusion:parquet 202934072 202982811 1.00
tpch_q13/datafusion:parquet 327107568 332932906 0.98
tpch_q14/datafusion:parquet 161439884 162902864 0.99
tpch_q15/datafusion:parquet 253987751 255814008 0.99
tpch_q16/datafusion:parquet 126673123 124632519 1.02
tpch_q17/datafusion:parquet 684295192 695287103 0.98
tpch_q18/datafusion:parquet 905629198 917135829 0.99
tpch_q19/datafusion:parquet 268785530 260738469 1.03
tpch_q20/datafusion:parquet 291466881 300187961 0.97
tpch_q21/datafusion:parquet 704556747 706942895 1.00
tpch_q22/datafusion:parquet 218139072 215568771 1.01
datafusion / arrow (1.054x ➖, 0↑ 5↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 706737109 590950090 1.20
tpch_q02/datafusion:arrow 🚨 199976369 166554346 1.20
tpch_q03/datafusion:arrow 🚨 599730852 469738720 1.28
tpch_q04/datafusion:arrow 🚨 427153792 334947318 1.28
tpch_q05/datafusion:arrow 973848556 932491154 1.04
tpch_q06/datafusion:arrow 286570655 284262482 1.01
tpch_q07/datafusion:arrow 1194917527 1180143983 1.01
tpch_q08/datafusion:arrow 1256806666 1149769885 1.09
tpch_q09/datafusion:arrow 1455563759 1367872217 1.06
tpch_q10/datafusion:arrow 620164235 597685071 1.04
tpch_q11/datafusion:arrow 143559092 139878514 1.03
tpch_q12/datafusion:arrow 🚨 801829824 717845330 1.12
tpch_q13/datafusion:arrow 504038498 511418717 0.99
tpch_q14/datafusion:arrow 317124277 318443083 1.00
tpch_q15/datafusion:arrow 681193864 702269858 0.97
tpch_q16/datafusion:arrow 105463100 106052847 0.99
tpch_q17/datafusion:arrow 1329805932 1349382734 0.99
tpch_q18/datafusion:arrow 1913265406 1940895589 0.99
tpch_q19/datafusion:arrow 497191617 484805407 1.03
tpch_q20/datafusion:arrow 484825463 486526560 1.00
tpch_q21/datafusion:arrow 2945458253 3015467794 0.98
tpch_q22/datafusion:arrow 131385374 129843492 1.01
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169319599 171091630 0.99
tpch_q02/duckdb:vortex-file-compressed 53503655 51800675 1.03
tpch_q03/duckdb:vortex-file-compressed 123030070 123544854 1.00
tpch_q04/duckdb:vortex-file-compressed 157323984 159888398 0.98
tpch_q05/duckdb:vortex-file-compressed 138755596 138754505 1.00
tpch_q06/duckdb:vortex-file-compressed 33833437 37579260 0.90
tpch_q07/duckdb:vortex-file-compressed 133403532 132922713 1.00
tpch_q08/duckdb:vortex-file-compressed 170061500 171555382 0.99
tpch_q09/duckdb:vortex-file-compressed 395467187 398637540 0.99
tpch_q10/duckdb:vortex-file-compressed 195939334 191256884 1.02
tpch_q11/duckdb:vortex-file-compressed 32614074 32606209 1.00
tpch_q12/duckdb:vortex-file-compressed 102826879 102037899 1.01
tpch_q13/duckdb:vortex-file-compressed 274470954 276602320 0.99
tpch_q14/duckdb:vortex-file-compressed 53141850 53952202 0.98
tpch_q15/duckdb:vortex-file-compressed 89672963 89709505 1.00
tpch_q16/duckdb:vortex-file-compressed 77887114 77565867 1.00
tpch_q17/duckdb:vortex-file-compressed 92235725 94157083 0.98
tpch_q18/duckdb:vortex-file-compressed 291874331 285031657 1.02
tpch_q19/duckdb:vortex-file-compressed 79743701 79727541 1.00
tpch_q20/duckdb:vortex-file-compressed 142766159 144981278 0.98
tpch_q21/duckdb:vortex-file-compressed 489089943 494036213 0.99
tpch_q22/duckdb:vortex-file-compressed 64220958 64647803 0.99
duckdb / vortex-compact (0.987x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 227690416 232032065 0.98
tpch_q02/duckdb:vortex-compact 56071316 58196164 0.96
tpch_q03/duckdb:vortex-compact 136415223 137997375 0.99
tpch_q04/duckdb:vortex-compact 170566433 170655368 1.00
tpch_q05/duckdb:vortex-compact 163476869 166258203 0.98
tpch_q06/duckdb:vortex-compact 55632972 58768716 0.95
tpch_q07/duckdb:vortex-compact 172655387 175938738 0.98
tpch_q08/duckdb:vortex-compact 187968504 188851652 1.00
tpch_q09/duckdb:vortex-compact 423643134 429461009 0.99
tpch_q10/duckdb:vortex-compact 218862080 219704341 1.00
tpch_q11/duckdb:vortex-compact 38736948 39166774 0.99
tpch_q12/duckdb:vortex-compact 163568409 163895691 1.00
tpch_q13/duckdb:vortex-compact 323474324 325588012 0.99
tpch_q14/duckdb:vortex-compact 72243315 72393928 1.00
tpch_q15/duckdb:vortex-compact 112957873 114425767 0.99
tpch_q16/duckdb:vortex-compact 80545461 81256296 0.99
tpch_q17/duckdb:vortex-compact 105961213 107826778 0.98
tpch_q18/duckdb:vortex-compact 290803678 292438898 0.99
tpch_q19/duckdb:vortex-compact 96041527 97251665 0.99
tpch_q20/duckdb:vortex-compact 175535422 175767854 1.00
tpch_q21/duckdb:vortex-compact 509670277 525075627 0.97
tpch_q22/duckdb:vortex-compact 71186232 71669615 0.99
duckdb / parquet (1.002x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 262419956 265548691 0.99
tpch_q02/duckdb:parquet 103665312 99664182 1.04
tpch_q03/duckdb:parquet 210704186 207231019 1.02
tpch_q04/duckdb:parquet 136865023 134520722 1.02
tpch_q05/duckdb:parquet 225339274 227176448 0.99
tpch_q06/duckdb:parquet 74707124 74783594 1.00
tpch_q07/duckdb:parquet 185511734 188171879 0.99
tpch_q08/duckdb:parquet 261930228 265537381 0.99
tpch_q09/duckdb:parquet 477191790 474871213 1.00
tpch_q10/duckdb:parquet 621621479 616460102 1.01
tpch_q11/duckdb:parquet 66704845 65460663 1.02
tpch_q12/duckdb:parquet 131039869 132151456 0.99
tpch_q13/duckdb:parquet 454042986 453464445 1.00
tpch_q14/duckdb:parquet 179614426 176596551 1.02
tpch_q15/duckdb:parquet 103714673 105034327 0.99
tpch_q16/duckdb:parquet 162785072 160916168 1.01
tpch_q17/duckdb:parquet 182157966 180435993 1.01
tpch_q18/duckdb:parquet 363363498 367586139 0.99
tpch_q19/duckdb:parquet 285781870 283691654 1.01
tpch_q20/duckdb:parquet 221525616 227385854 0.97
tpch_q21/duckdb:parquet 552036852 556615947 0.99
tpch_q22/duckdb:parquet 295072712 295158242 1.00
duckdb / duckdb (0.998x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 119718961 120891868 0.99
tpch_q02/duckdb:duckdb 51472798 52546718 0.98
tpch_q03/duckdb:duckdb 102962446 103781155 0.99
tpch_q04/duckdb:duckdb 139015943 138896426 1.00
tpch_q05/duckdb:duckdb 118307871 118389096 1.00
tpch_q06/duckdb:duckdb 44480519 44848047 0.99
tpch_q07/duckdb:duckdb 89926700 91124501 0.99
tpch_q08/duckdb:duckdb 117783302 117727456 1.00
tpch_q09/duckdb:duckdb 278803114 281578058 0.99
tpch_q10/duckdb:duckdb 216796829 213006809 1.02
tpch_q11/duckdb:duckdb 19375338 19157724 1.01
tpch_q12/duckdb:duckdb 89352305 90573401 0.99
tpch_q13/duckdb:duckdb 230102029 231597545 0.99
tpch_q14/duckdb:duckdb 77406490 77726066 1.00
tpch_q15/duckdb:duckdb 81183358 82308490 0.99
tpch_q16/duckdb:duckdb 75331468 75331555 1.00
tpch_q17/duckdb:duckdb 87937157 87671978 1.00
tpch_q18/duckdb:duckdb 230451100 233521322 0.99
tpch_q19/duckdb:duckdb 123811269 123978782 1.00
tpch_q20/duckdb:duckdb 117270476 118014403 0.99
tpch_q21/duckdb:duckdb 301029508 307021077 0.98
tpch_q22/duckdb:duckdb 68825404 64248878 1.07
File Size Changes (36 files changed, -2.1% overall, 11↑ 25↓)
File Scale Format Base HEAD Change %
part_1.vortex 10.0 vortex-compact 16.83 MB 17.00 MB +170.62 KB +1.0%
partsupp_0.vortex 10.0 vortex-compact 104.46 MB 104.91 MB +460.59 KB +0.4%
lineitem_11.vortex 10.0 vortex-compact 100.53 MB 100.53 MB +3.45 KB +0.0%
lineitem_6.vortex 10.0 vortex-compact 100.68 MB 100.68 MB +3.42 KB +0.0%
lineitem_5.vortex 10.0 vortex-compact 100.70 MB 100.70 MB +1.83 KB +0.0%
lineitem_3.vortex 10.0 vortex-compact 100.62 MB 100.62 MB +1.80 KB +0.0%
lineitem_1.vortex 10.0 vortex-compact 100.64 MB 100.65 MB +1.78 KB +0.0%
lineitem_9.vortex 10.0 vortex-compact 100.46 MB 100.47 MB +1.74 KB +0.0%
lineitem_10.vortex 10.0 vortex-compact 100.62 MB 100.62 MB +1.74 KB +0.0%
lineitem_8.vortex 10.0 vortex-compact 100.59 MB 100.59 MB +1.71 KB +0.0%
lineitem_12.vortex 10.0 vortex-compact 100.62 MB 100.62 MB +1.10 KB +0.0%
customer_0.vortex 10.0 vortex-compact 74.12 MB 74.09 MB 25.06 KB -0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 120.32 MB 119.80 MB 533.23 KB -0.4%
partsupp_1.vortex 10.0 vortex-file-compressed 120.35 MB 119.74 MB 630.74 KB -0.5%
partsupp_1.vortex 10.0 vortex-compact 105.27 MB 104.52 MB 765.52 KB -0.7%
supplier_0.vortex 10.0 vortex-file-compressed 5.71 MB 5.66 MB 44.93 KB -0.8%
part_0.vortex 10.0 vortex-compact 16.98 MB 16.85 MB 135.70 KB -0.8%
customer_0.vortex 10.0 vortex-file-compressed 88.49 MB 86.99 MB 1.51 MB -1.7%
lineitem_6.vortex 10.0 vortex-file-compressed 132.70 MB 129.49 MB 3.22 MB -2.4%
lineitem_3.vortex 10.0 vortex-file-compressed 133.14 MB 129.39 MB 3.75 MB -2.8%
lineitem_5.vortex 10.0 vortex-file-compressed 133.65 MB 129.74 MB 3.91 MB -2.9%
lineitem_7.vortex 10.0 vortex-file-compressed 133.65 MB 129.34 MB 4.31 MB -3.2%
lineitem_1.vortex 10.0 vortex-file-compressed 133.69 MB 129.35 MB 4.35 MB -3.3%
lineitem_2.vortex 10.0 vortex-file-compressed 133.90 MB 129.51 MB 4.39 MB -3.3%
lineitem_8.vortex 10.0 vortex-file-compressed 133.51 MB 129.11 MB 4.39 MB -3.3%
lineitem_12.vortex 10.0 vortex-file-compressed 133.94 MB 129.52 MB 4.42 MB -3.3%
lineitem_4.vortex 10.0 vortex-file-compressed 133.97 MB 129.48 MB 4.49 MB -3.4%
part_0.vortex 10.0 vortex-file-compressed 24.65 MB 23.80 MB 870.79 KB -3.5%
lineitem_0.vortex 10.0 vortex-file-compressed 134.19 MB 129.48 MB 4.70 MB -3.5%
lineitem_10.vortex 10.0 vortex-file-compressed 134.17 MB 129.44 MB 4.73 MB -3.5%
lineitem_9.vortex 10.0 vortex-file-compressed 134.20 MB 129.21 MB 4.99 MB -3.7%
lineitem_11.vortex 10.0 vortex-file-compressed 134.38 MB 129.25 MB 5.13 MB -3.8%
part_1.vortex 10.0 vortex-file-compressed 24.92 MB 23.74 MB 1.17 MB -4.7%
orders_0.vortex 10.0 vortex-file-compressed 144.12 MB 133.23 MB 10.89 MB -7.6%
orders_1.vortex 10.0 vortex-file-compressed 145.60 MB 134.53 MB 11.07 MB -7.6%
orders_2.vortex 10.0 vortex-file-compressed 145.71 MB 134.06 MB 11.65 MB -8.0%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (-0.0%)
  • vortex-file-compressed: 2.50 GB → 2.41 GB (-3.7%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +19.6% +1.0% +18.4% +10.0% 🚨 regression
1 datafusion:vortex-compact -1.3% +1.0% -2.3% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -4.0% +1.0% -4.9% +10.0% ➖ noise
1 duckdb:duckdb -1.0% +1.0% -1.9% +10.0% ➖ noise
1 duckdb:vortex-compact -1.9% +1.0% -2.8% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -1.0% +1.0% -2.0% +10.0% ➖ noise
2 datafusion:arrow +20.1% +1.6% +18.2% +10.0% 🚨 regression
2 datafusion:vortex-compact -1.1% +1.6% -2.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -3.8% +1.6% -5.3% +10.0% ➖ noise
2 duckdb:duckdb -2.0% +1.6% -3.6% +10.0% ➖ noise
2 duckdb:vortex-compact -3.7% +1.6% -5.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +3.3% +1.6% +1.7% +12.0% ➖ noise
3 datafusion:arrow +27.7% +0.3% +27.3% +10.0% 🚨 regression
3 datafusion:vortex-compact -0.4% +0.3% -0.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -0.7% +0.3% -1.0% +10.0% ➖ noise
3 duckdb:duckdb -0.8% +0.3% -1.1% +10.0% ➖ noise
3 duckdb:vortex-compact -1.1% +0.3% -1.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.4% +0.3% -0.7% +10.0% ➖ noise
4 datafusion:arrow +27.5% +0.8% +26.5% +10.0% 🚨 regression
4 datafusion:vortex-compact +0.2% +0.8% -0.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -6.2% +0.8% -6.9% +10.0% ➖ noise
4 duckdb:duckdb +0.1% +0.8% -0.7% +10.0% ➖ noise
4 duckdb:vortex-compact -0.1% +0.8% -0.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.6% +0.8% -2.4% +10.0% ➖ noise
5 datafusion:arrow +4.4% -1.1% +5.6% +10.0% ➖ noise
5 datafusion:vortex-compact -1.0% -1.1% +0.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.5% -1.1% -0.5% +10.0% ➖ noise
5 duckdb:duckdb -0.1% -1.1% +1.0% +10.0% ➖ noise
5 duckdb:vortex-compact -1.7% -1.1% -0.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.0% -1.1% +1.1% +10.0% ➖ noise
6 datafusion:arrow +0.8% +0.5% +0.3% +10.0% ➖ noise
6 datafusion:vortex-compact +0.8% +0.5% +0.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.7% +0.5% +1.2% +10.0% ➖ noise
6 duckdb:duckdb -0.8% +0.5% -1.3% +10.0% ➖ noise
6 duckdb:vortex-compact -5.3% +0.5% -5.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -10.0% +0.5% -10.4% +11.5% ✅ faster
7 datafusion:arrow +1.3% -1.3% +2.6% +10.0% ➖ noise
7 datafusion:vortex-compact -1.4% -1.3% -0.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.6% -1.3% +0.7% +10.0% ➖ noise
7 duckdb:duckdb -1.3% -1.3% -0.0% +10.0% ➖ noise
7 duckdb:vortex-compact -1.9% -1.3% -0.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.4% -1.3% +1.7% +10.0% ➖ noise
8 datafusion:arrow +9.3% -1.5% +10.9% +10.0% 🚨 regression
8 datafusion:vortex-compact -1.6% -1.5% -0.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.4% -1.5% +1.1% +10.0% ➖ noise
8 duckdb:duckdb +0.0% -1.5% +1.5% +10.0% ➖ noise
8 duckdb:vortex-compact -0.5% -1.5% +1.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.9% -1.5% +0.6% +10.0% ➖ noise
9 datafusion:arrow +6.4% -0.7% +7.2% +10.0% ➖ noise
9 datafusion:vortex-compact -1.5% -0.7% -0.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.1% -0.7% -0.3% +10.0% ➖ noise
9 duckdb:duckdb -1.0% -0.7% -0.2% +10.0% ➖ noise
9 duckdb:vortex-compact -1.4% -0.7% -0.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.8% -0.7% -0.0% +10.0% ➖ noise
10 datafusion:arrow +3.8% +0.8% +2.9% +10.0% ➖ noise
10 datafusion:vortex-compact -2.3% +0.8% -3.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.2% +0.8% -0.7% +10.0% ➖ noise
10 duckdb:duckdb +1.8% +0.8% +0.9% +10.0% ➖ noise
10 duckdb:vortex-compact -0.4% +0.8% -1.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.4% +0.8% +1.6% +10.0% ➖ noise
11 datafusion:arrow +2.6% -0.1% +2.7% +12.2% ➖ noise
11 datafusion:vortex-compact -1.1% -0.1% -1.0% +10.2% ➖ noise
11 datafusion:vortex-file-compressed -2.8% -0.1% -2.7% +10.0% ➖ noise
11 duckdb:duckdb +1.1% -0.1% +1.2% +10.0% ➖ noise
11 duckdb:vortex-compact -1.1% -0.1% -1.0% +11.4% ➖ noise
11 duckdb:vortex-file-compressed +0.0% -0.1% +0.1% +20.5% ➖ noise
12 datafusion:arrow +11.7% -0.4% +12.2% +36.6% ➖ noise
12 datafusion:vortex-compact +0.1% -0.4% +0.6% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.6% -0.4% +2.0% +10.0% ➖ noise
12 duckdb:duckdb -1.3% -0.4% -0.9% +10.0% ➖ noise
12 duckdb:vortex-compact -0.2% -0.4% +0.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.8% -0.4% +1.2% +10.0% ➖ noise
13 datafusion:arrow -1.4% -0.8% -0.6% +10.0% ➖ noise
13 datafusion:vortex-compact -1.5% -0.8% -0.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.8% -0.8% +0.0% +10.0% ➖ noise
13 duckdb:duckdb -0.6% -0.8% +0.2% +10.0% ➖ noise
13 duckdb:vortex-compact -0.6% -0.8% +0.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.8% -0.8% +0.0% +10.0% ➖ noise
14 datafusion:arrow -0.4% +0.4% -0.8% +10.0% ➖ noise
14 datafusion:vortex-compact -1.4% +0.4% -1.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.8% +0.4% +1.4% +10.0% ➖ noise
14 duckdb:duckdb -0.4% +0.4% -0.8% +10.0% ➖ noise
14 duckdb:vortex-compact -0.2% +0.4% -0.6% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.5% +0.4% -1.9% +10.0% ➖ noise
15 datafusion:arrow -3.0% -1.0% -2.0% +10.0% ➖ noise
15 datafusion:vortex-compact -2.2% -1.0% -1.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -1.1% -1.0% -0.1% +10.0% ➖ noise
15 duckdb:duckdb -1.4% -1.0% -0.4% +10.0% ➖ noise
15 duckdb:vortex-compact -1.3% -1.0% -0.3% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.0% -1.0% +1.0% +10.0% ➖ noise
16 datafusion:arrow -0.6% +1.4% -1.9% +10.0% ➖ noise
16 datafusion:vortex-compact -0.0% +1.4% -1.4% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -0.2% +1.4% -1.6% +10.0% ➖ noise
16 duckdb:duckdb -0.0% +1.4% -1.4% +10.0% ➖ noise
16 duckdb:vortex-compact -0.9% +1.4% -2.2% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.4% +1.4% -1.0% +10.0% ➖ noise
17 datafusion:arrow -1.5% -0.3% -1.1% +10.0% ➖ noise
17 datafusion:vortex-compact -1.5% -0.3% -1.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -2.1% -0.3% -1.8% +10.0% ➖ noise
17 duckdb:duckdb +0.3% -0.3% +0.6% +10.0% ➖ noise
17 duckdb:vortex-compact -1.7% -0.3% -1.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -2.0% -0.3% -1.7% +10.0% ➖ noise
18 datafusion:arrow -1.4% -1.2% -0.2% +10.0% ➖ noise
18 datafusion:vortex-compact -1.2% -1.2% -0.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.0% -1.2% -0.8% +10.0% ➖ noise
18 duckdb:duckdb -1.3% -1.2% -0.1% +10.0% ➖ noise
18 duckdb:vortex-compact -0.6% -1.2% +0.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.4% -1.2% +3.6% +10.0% ➖ noise
19 datafusion:arrow +2.6% +1.9% +0.6% +10.0% ➖ noise
19 datafusion:vortex-compact -0.9% +1.9% -2.7% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -3.1% +1.9% -4.9% +10.0% ➖ noise
19 duckdb:duckdb -0.1% +1.9% -2.0% +10.0% ➖ noise
19 duckdb:vortex-compact -1.2% +1.9% -3.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +0.0% +1.9% -1.8% +10.0% ➖ noise
20 datafusion:arrow -0.3% -2.7% +2.5% +10.0% ➖ noise
20 datafusion:vortex-compact -3.1% -2.7% -0.4% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.6% -2.7% +1.2% +10.0% ➖ noise
20 duckdb:duckdb -0.6% -2.7% +2.2% +10.0% ➖ noise
20 duckdb:vortex-compact -0.1% -2.7% +2.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -1.5% -2.7% +1.2% +10.0% ➖ noise
21 datafusion:arrow -2.3% -0.6% -1.8% +10.0% ➖ noise
21 datafusion:vortex-compact +0.4% -0.6% +1.0% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -4.3% -0.6% -3.8% +10.0% ➖ noise
21 duckdb:duckdb -2.0% -0.6% -1.4% +10.0% ➖ noise
21 duckdb:vortex-compact -2.9% -0.6% -2.4% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -1.0% -0.6% -0.4% +10.0% ➖ noise
22 datafusion:arrow +1.2% +0.6% +0.6% +10.0% ➖ noise
22 datafusion:vortex-compact -4.1% +0.6% -4.6% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -3.1% +0.6% -3.7% +10.0% ➖ noise
22 duckdb:duckdb +7.1% +0.6% +6.5% +10.0% ➖ noise
22 duckdb:vortex-compact -0.7% +0.6% -1.2% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.7% +0.6% -1.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+2.2%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): 1.034x ➖
Parquet (geomean): 1.025x ➖
Shifts: Parquet (control) +2.5% · Median polish +1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.071x ➖, 0↑ 12↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1745001 1724573 1.01
clickbench_q01/datafusion:vortex-file-compressed 17611109 17453523 1.01
clickbench_q02/datafusion:vortex-file-compressed 🚨 40396323 35367476 1.14
clickbench_q03/datafusion:vortex-file-compressed 🚨 49956784 44527622 1.12
clickbench_q04/datafusion:vortex-file-compressed 304259877 281269426 1.08
clickbench_q05/datafusion:vortex-file-compressed 🚨 366552869 328140778 1.12
clickbench_q06/datafusion:vortex-file-compressed 🚨 3060606 1697504 1.80
clickbench_q07/datafusion:vortex-file-compressed 🚨 23309914 20660622 1.13
clickbench_q08/datafusion:vortex-file-compressed 380714554 348474669 1.09
clickbench_q09/datafusion:vortex-file-compressed 599570726 556347971 1.08
clickbench_q10/datafusion:vortex-file-compressed 🚨 86599589 75328065 1.15
clickbench_q11/datafusion:vortex-file-compressed 91474643 86392635 1.06
clickbench_q12/datafusion:vortex-file-compressed 313656305 290457064 1.08
clickbench_q13/datafusion:vortex-file-compressed 459128239 439183143 1.05
clickbench_q14/datafusion:vortex-file-compressed 🚨 297510536 268493123 1.11
clickbench_q15/datafusion:vortex-file-compressed 336440073 322158783 1.04
clickbench_q16/datafusion:vortex-file-compressed 698860178 681452807 1.03
clickbench_q17/datafusion:vortex-file-compressed 681306317 664637255 1.03
clickbench_q18/datafusion:vortex-file-compressed 1432895365 1381621310 1.04
clickbench_q19/datafusion:vortex-file-compressed 🚨 30912558 27697883 1.12
clickbench_q20/datafusion:vortex-file-compressed 337573733 323259860 1.04
clickbench_q21/datafusion:vortex-file-compressed 429989916 409711107 1.05
clickbench_q22/datafusion:vortex-file-compressed 531262228 515584526 1.03
clickbench_q23/datafusion:vortex-file-compressed 589486065 548620137 1.07
clickbench_q24/datafusion:vortex-file-compressed 49463768 49649741 1.00
clickbench_q25/datafusion:vortex-file-compressed 80653368 77715476 1.04
clickbench_q26/datafusion:vortex-file-compressed 🚨 52316734 47400506 1.10
clickbench_q27/datafusion:vortex-file-compressed 🚨 821348997 736668900 1.11
clickbench_q28/datafusion:vortex-file-compressed 6096743487 5828085080 1.05
clickbench_q29/datafusion:vortex-file-compressed 219222944 219109307 1.00
clickbench_q30/datafusion:vortex-file-compressed 272720082 254906643 1.07
clickbench_q31/datafusion:vortex-file-compressed 🚨 317390753 288381882 1.10
clickbench_q32/datafusion:vortex-file-compressed 🚨 1263324590 1119243898 1.13
clickbench_q33/datafusion:vortex-file-compressed 1482206246 1360565180 1.09
clickbench_q34/datafusion:vortex-file-compressed 1410348636 1377384814 1.02
clickbench_q35/datafusion:vortex-file-compressed 451516994 460404523 0.98
clickbench_q36/datafusion:vortex-file-compressed 75683985 72085677 1.05
clickbench_q37/datafusion:vortex-file-compressed 35757569 34790636 1.03
clickbench_q38/datafusion:vortex-file-compressed 21293653 21264202 1.00
clickbench_q39/datafusion:vortex-file-compressed 141546844 143448488 0.99
clickbench_q40/datafusion:vortex-file-compressed 16122083 16059885 1.00
clickbench_q41/datafusion:vortex-file-compressed 15259604 14976838 1.02
clickbench_q42/datafusion:vortex-file-compressed 17353239 16851005 1.03
datafusion / parquet (1.048x ➖, 0↑ 7↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1639077 1551806 1.06
clickbench_q01/datafusion:parquet 19308761 19397740 1.00
clickbench_q02/datafusion:parquet 46880536 46818692 1.00
clickbench_q03/datafusion:parquet 🚨 43137742 37617955 1.15
clickbench_q04/datafusion:parquet 🚨 331765847 300567832 1.10
clickbench_q05/datafusion:parquet 381720537 349642842 1.09
clickbench_q06/datafusion:parquet 🚨 1781941 1557022 1.14
clickbench_q07/datafusion:parquet 23038065 22220565 1.04
clickbench_q08/datafusion:parquet 🚨 417322616 371806396 1.12
clickbench_q09/datafusion:parquet 703137505 640474370 1.10
clickbench_q10/datafusion:parquet 112649614 108954488 1.03
clickbench_q11/datafusion:parquet 🚨 157939542 134337735 1.18
clickbench_q12/datafusion:parquet 357734503 338587404 1.06
clickbench_q13/datafusion:parquet 533514217 515945015 1.03
clickbench_q14/datafusion:parquet 337601565 347361065 0.97
clickbench_q15/datafusion:parquet 339321710 346921519 0.98
clickbench_q16/datafusion:parquet 700877636 685235270 1.02
clickbench_q17/datafusion:parquet 674588462 650126182 1.04
clickbench_q18/datafusion:parquet 1397756787 1405035022 0.99
clickbench_q19/datafusion:parquet 29824390 30829668 0.97
clickbench_q20/datafusion:parquet 623047358 615421723 1.01
clickbench_q21/datafusion:parquet 691849501 676200780 1.02
clickbench_q22/datafusion:parquet 1007871157 972284342 1.04
clickbench_q23/datafusion:parquet 3961967111 3691663171 1.07
clickbench_q24/datafusion:parquet 88899771 84523965 1.05
clickbench_q25/datafusion:parquet 🚨 147627990 133179053 1.11
clickbench_q26/datafusion:parquet 88851119 86222176 1.03
clickbench_q27/datafusion:parquet 1136195342 1060044512 1.07
clickbench_q28/datafusion:parquet 6651703163 6664100922 1.00
clickbench_q29/datafusion:parquet 239941541 235144068 1.02
clickbench_q30/datafusion:parquet 340075642 334201140 1.02
clickbench_q31/datafusion:parquet 391368640 363924931 1.08
clickbench_q32/datafusion:parquet 🚨 1296214838 1176056698 1.10
clickbench_q33/datafusion:parquet 1515248944 1476528369 1.03
clickbench_q34/datafusion:parquet 1566718371 1507103497 1.04
clickbench_q35/datafusion:parquet 503596231 477676119 1.05
clickbench_q36/datafusion:parquet 148940794 148513028 1.00
clickbench_q37/datafusion:parquet 60398857 58398598 1.03
clickbench_q38/datafusion:parquet 92468654 88281859 1.05
clickbench_q39/datafusion:parquet 293555451 268998609 1.09
clickbench_q40/datafusion:parquet 32471075 31550842 1.03
clickbench_q41/datafusion:parquet 28326587 27183232 1.04
clickbench_q42/datafusion:parquet 32395245 30952953 1.05
duckdb / vortex-file-compressed (0.998x ➖, 1↑ 1↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 7254760 7132419 1.02
clickbench_q01/duckdb:vortex-file-compressed 🚀 10643014 11971582 0.89
clickbench_q02/duckdb:vortex-file-compressed 25579347 25181810 1.02
clickbench_q03/duckdb:vortex-file-compressed 30625655 30376468 1.01
clickbench_q04/duckdb:vortex-file-compressed 185594643 187421317 0.99
clickbench_q05/duckdb:vortex-file-compressed 179934804 177793076 1.01
clickbench_q06/duckdb:vortex-file-compressed 19837279 20288122 0.98
clickbench_q07/duckdb:vortex-file-compressed 🚨 15807642 14043537 1.13
clickbench_q08/duckdb:vortex-file-compressed 261799613 266875606 0.98
clickbench_q09/duckdb:vortex-file-compressed 338827255 340262098 1.00
clickbench_q10/duckdb:vortex-file-compressed 70372339 68427731 1.03
clickbench_q11/duckdb:vortex-file-compressed 81926126 78145629 1.05
clickbench_q12/duckdb:vortex-file-compressed 198544394 198698541 1.00
clickbench_q13/duckdb:vortex-file-compressed 405828359 405666853 1.00
clickbench_q14/duckdb:vortex-file-compressed 235669239 236266738 1.00
clickbench_q15/duckdb:vortex-file-compressed 243454721 244339555 1.00
clickbench_q16/duckdb:vortex-file-compressed 527639138 532386335 0.99
clickbench_q17/duckdb:vortex-file-compressed 425906799 427225745 1.00
clickbench_q18/duckdb:vortex-file-compressed 947013076 955812895 0.99
clickbench_q19/duckdb:vortex-file-compressed 22350268 22202504 1.01
clickbench_q20/duckdb:vortex-file-compressed 304685914 319204354 0.95
clickbench_q21/duckdb:vortex-file-compressed 394192480 392417132 1.00
clickbench_q22/duckdb:vortex-file-compressed 600304902 562976832 1.07
clickbench_q23/duckdb:vortex-file-compressed 197378575 206234671 0.96
clickbench_q24/duckdb:vortex-file-compressed 43672372 43079977 1.01
clickbench_q25/duckdb:vortex-file-compressed 74304698 74990335 0.99
clickbench_q26/duckdb:vortex-file-compressed 49854848 47400348 1.05
clickbench_q27/duckdb:vortex-file-compressed 528294526 524656766 1.01
clickbench_q28/duckdb:vortex-file-compressed 3108824426 3067058841 1.01
clickbench_q29/duckdb:vortex-file-compressed 28222436 27946530 1.01
clickbench_q30/duckdb:vortex-file-compressed 213914698 212761092 1.01
clickbench_q31/duckdb:vortex-file-compressed 311346616 307380478 1.01
clickbench_q32/duckdb:vortex-file-compressed 1113971743 1117540212 1.00
clickbench_q33/duckdb:vortex-file-compressed 1093282058 1135048538 0.96
clickbench_q34/duckdb:vortex-file-compressed 1189415905 1210630277 0.98
clickbench_q35/duckdb:vortex-file-compressed 374838690 374842570 1.00
clickbench_q36/duckdb:vortex-file-compressed 26313873 26974327 0.98
clickbench_q37/duckdb:vortex-file-compressed 17759109 18857427 0.94
clickbench_q38/duckdb:vortex-file-compressed 19779458 19588923 1.01
clickbench_q39/duckdb:vortex-file-compressed 44009045 41859654 1.05
clickbench_q40/duckdb:vortex-file-compressed 17904363 17605540 1.02
clickbench_q41/duckdb:vortex-file-compressed 16633847 17671165 0.94
clickbench_q42/duckdb:vortex-file-compressed 17383592 18692673 0.93
duckdb / parquet (1.003x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 22841939 22607482 1.01
clickbench_q01/duckdb:parquet 29104781 30823334 0.94
clickbench_q02/duckdb:parquet 49964485 50482919 0.99
clickbench_q03/duckdb:parquet 39981670 40005053 1.00
clickbench_q04/duckdb:parquet 205403321 200084577 1.03
clickbench_q05/duckdb:parquet 261768867 258840694 1.01
clickbench_q06/duckdb:parquet 47385363 47266966 1.00
clickbench_q07/duckdb:parquet 31496871 31301086 1.01
clickbench_q08/duckdb:parquet 271352541 266553830 1.02
clickbench_q09/duckdb:parquet 398546169 397574417 1.00
clickbench_q10/duckdb:parquet 79762448 82904338 0.96
clickbench_q11/duckdb:parquet 99367559 99329389 1.00
clickbench_q12/duckdb:parquet 279588422 277355419 1.01
clickbench_q13/duckdb:parquet 471178333 467713365 1.01
clickbench_q14/duckdb:parquet 320651320 316271171 1.01
clickbench_q15/duckdb:parquet 259514773 256060622 1.01
clickbench_q16/duckdb:parquet 593601616 600046160 0.99
clickbench_q17/duckdb:parquet 499645038 501462822 1.00
clickbench_q18/duckdb:parquet 1031018701 1039243521 0.99
clickbench_q19/duckdb:parquet 27925513 27714127 1.01
clickbench_q20/duckdb:parquet 422613317 418569068 1.01
clickbench_q21/duckdb:parquet 534588969 529605178 1.01
clickbench_q22/duckdb:parquet 924152196 926896860 1.00
clickbench_q23/duckdb:parquet 273075607 262485747 1.04
clickbench_q24/duckdb:parquet 72289720 71607350 1.01
clickbench_q25/duckdb:parquet 163283018 163031545 1.00
clickbench_q26/duckdb:parquet 54330383 52620924 1.03
clickbench_q27/duckdb:parquet 643489835 640027179 1.01
clickbench_q28/duckdb:parquet 4916567884 4884566183 1.01
clickbench_q29/duckdb:parquet 42503865 42291122 1.01
clickbench_q30/duckdb:parquet 312225187 307840557 1.01
clickbench_q31/duckdb:parquet 375637799 373661251 1.01
clickbench_q32/duckdb:parquet 1103289922 1119424411 0.99
clickbench_q33/duckdb:parquet 1096587270 1099914397 1.00
clickbench_q34/duckdb:parquet 1142825336 1148503923 1.00
clickbench_q35/duckdb:parquet 369010776 371161797 0.99
clickbench_q36/duckdb:parquet 45818632 49555597 0.92
clickbench_q37/duckdb:parquet 34113580 34277585 1.00
clickbench_q38/duckdb:parquet 34630800 35281657 0.98
clickbench_q39/duckdb:parquet 77000423 76699870 1.00
clickbench_q40/duckdb:parquet 20321771 19802042 1.03
clickbench_q41/duckdb:parquet 21034359 20104677 1.05
clickbench_q42/duckdb:parquet 23389883 22071046 1.06
duckdb / duckdb (1.021x ➖, 1↑ 1↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚨 19559007 17102250 1.14
clickbench_q01/duckdb:duckdb 36221773 33973553 1.07
clickbench_q02/duckdb:duckdb 52747497 51275478 1.03
clickbench_q03/duckdb:duckdb 57438441 55376161 1.04
clickbench_q04/duckdb:duckdb 211557471 209142422 1.01
clickbench_q05/duckdb:duckdb 284139820 279856105 1.02
clickbench_q06/duckdb:duckdb 35614227 33449979 1.06
clickbench_q07/duckdb:duckdb 36959492 35176152 1.05
clickbench_q08/duckdb:duckdb 273612146 270437005 1.01
clickbench_q09/duckdb:duckdb 398507967 393853152 1.01
clickbench_q10/duckdb:duckdb 117998192 116992903 1.01
clickbench_q11/duckdb:duckdb 128148876 124685873 1.03
clickbench_q12/duckdb:duckdb 262639144 261608254 1.00
clickbench_q13/duckdb:duckdb 440534832 446914064 0.99
clickbench_q14/duckdb:duckdb 286822532 283216490 1.01
clickbench_q15/duckdb:duckdb 244458196 241047086 1.01
clickbench_q16/duckdb:duckdb 559981214 560200189 1.00
clickbench_q17/duckdb:duckdb 470989339 473845088 0.99
clickbench_q18/duckdb:duckdb 991377538 986323165 1.01
clickbench_q19/duckdb:duckdb 37344112 35164209 1.06
clickbench_q20/duckdb:duckdb 473063372 468672359 1.01
clickbench_q21/duckdb:duckdb 468696408 472837648 0.99
clickbench_q22/duckdb:duckdb 520952219 538585183 0.97
clickbench_q23/duckdb:duckdb 254136239 258007264 0.98
clickbench_q24/duckdb:duckdb 63987023 60330161 1.06
clickbench_q25/duckdb:duckdb 150840730 148676850 1.01
clickbench_q26/duckdb:duckdb 63820843 62191415 1.03
clickbench_q27/duckdb:duckdb 548344337 549559897 1.00
clickbench_q28/duckdb:duckdb 4466944395 4477502378 1.00
clickbench_q29/duckdb:duckdb 52384865 51176961 1.02
clickbench_q30/duckdb:duckdb 282158113 275932065 1.02
clickbench_q31/duckdb:duckdb 363488074 366896124 0.99
clickbench_q32/duckdb:duckdb 1105231355 1117156412 0.99
clickbench_q33/duckdb:duckdb 1109619099 1118125103 0.99
clickbench_q34/duckdb:duckdb 1177590614 1190942286 0.99
clickbench_q35/duckdb:duckdb 301301132 301124237 1.00
clickbench_q36/duckdb:duckdb 52002692 49699079 1.05
clickbench_q37/duckdb:duckdb 31013139 28216370 1.10
clickbench_q38/duckdb:duckdb 35485641 33134789 1.07
clickbench_q39/duckdb:duckdb 🚀 85271501 97401260 0.88
clickbench_q40/duckdb:duckdb 29467850 27720080 1.06
clickbench_q41/duckdb:duckdb 29418216 27145993 1.08
clickbench_q42/duckdb:duckdb 31532505 29341875 1.07
File Size Changes (102 files changed, -0.4% overall, 6↑ 96↓)
File Scale Format Base HEAD Change %
hits_35.vortex 1.0 vortex-file-compressed 115.11 MB 115.43 MB +333.06 KB +0.3%
hits_80.vortex 1.0 vortex-file-compressed 104.95 MB 105.06 MB +115.65 KB +0.1%
hits_97.vortex 1.0 vortex-file-compressed 107.02 MB 107.10 MB +83.48 KB +0.1%
hits_5.vortex 1.0 vortex-file-compressed 92.99 MB 93.06 MB +65.91 KB +0.1%
hits_35.vortex 1.0 vortex-compact 74.96 MB 74.98 MB +18.84 KB +0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.33 MB 122.34 MB +8.70 KB +0.0%
hits_6.vortex 1.0 vortex-file-compressed 93.29 MB 93.28 MB 11.34 KB -0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.41 MB 221.31 MB 106.29 KB -0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.68 MB 277.52 MB 162.18 KB -0.1%
hits_48.vortex 1.0 vortex-file-compressed 28.05 MB 28.03 MB 18.38 KB -0.1%
hits_78.vortex 1.0 vortex-file-compressed 164.30 MB 164.19 MB 113.60 KB -0.1%
hits_81.vortex 1.0 vortex-file-compressed 100.80 MB 100.70 MB 101.47 KB -0.1%
hits_28.vortex 1.0 vortex-file-compressed 119.83 MB 119.71 MB 121.84 KB -0.1%
hits_8.vortex 1.0 vortex-file-compressed 93.34 MB 93.25 MB 99.91 KB -0.1%
hits_9.vortex 1.0 vortex-file-compressed 99.17 MB 99.05 MB 120.68 KB -0.1%
hits_50.vortex 1.0 vortex-file-compressed 179.42 MB 179.18 MB 246.02 KB -0.1%
hits_0.vortex 1.0 vortex-file-compressed 89.63 MB 89.50 MB 127.01 KB -0.1%
hits_47.vortex 1.0 vortex-file-compressed 41.32 MB 41.26 MB 60.80 KB -0.1%
hits_10.vortex 1.0 vortex-file-compressed 69.60 MB 69.47 MB 129.37 KB -0.2%
hits_58.vortex 1.0 vortex-file-compressed 90.43 MB 90.25 MB 181.42 KB -0.2%
hits_38.vortex 1.0 vortex-file-compressed 99.29 MB 99.10 MB 200.85 KB -0.2%
hits_7.vortex 1.0 vortex-file-compressed 94.02 MB 93.83 MB 193.98 KB -0.2%
hits_66.vortex 1.0 vortex-file-compressed 90.31 MB 90.13 MB 188.79 KB -0.2%
hits_45.vortex 1.0 vortex-file-compressed 122.16 MB 121.90 MB 261.85 KB -0.2%
hits_90.vortex 1.0 vortex-file-compressed 142.09 MB 141.77 MB 321.76 KB -0.2%
hits_70.vortex 1.0 vortex-file-compressed 93.70 MB 93.49 MB 213.12 KB -0.2%
hits_55.vortex 1.0 vortex-file-compressed 169.30 MB 168.92 MB 388.05 KB -0.2%
hits_12.vortex 1.0 vortex-file-compressed 101.06 MB 100.82 MB 244.19 KB -0.2%
hits_33.vortex 1.0 vortex-file-compressed 57.24 MB 57.10 MB 143.88 KB -0.2%
hits_57.vortex 1.0 vortex-file-compressed 128.35 MB 128.00 MB 355.33 KB -0.3%
hits_14.vortex 1.0 vortex-file-compressed 111.46 MB 111.15 MB 320.03 KB -0.3%
hits_13.vortex 1.0 vortex-file-compressed 99.33 MB 99.05 MB 286.88 KB -0.3%
hits_92.vortex 1.0 vortex-file-compressed 146.91 MB 146.50 MB 424.36 KB -0.3%
hits_63.vortex 1.0 vortex-file-compressed 69.29 MB 69.08 MB 213.15 KB -0.3%
hits_60.vortex 1.0 vortex-file-compressed 103.37 MB 103.02 MB 355.54 KB -0.3%
hits_99.vortex 1.0 vortex-file-compressed 123.18 MB 122.74 MB 444.38 KB -0.4%
hits_56.vortex 1.0 vortex-file-compressed 123.55 MB 123.12 MB 446.19 KB -0.4%
hits_96.vortex 1.0 vortex-file-compressed 135.81 MB 135.32 MB 496.52 KB -0.4%
hits_75.vortex 1.0 vortex-file-compressed 63.44 MB 63.20 MB 242.91 KB -0.4%
hits_32.vortex 1.0 vortex-file-compressed 66.80 MB 66.54 MB 263.95 KB -0.4%
hits_69.vortex 1.0 vortex-file-compressed 123.01 MB 122.52 MB 498.29 KB -0.4%
hits_39.vortex 1.0 vortex-file-compressed 80.35 MB 80.03 MB 328.56 KB -0.4%
hits_59.vortex 1.0 vortex-file-compressed 101.95 MB 101.53 MB 423.23 KB -0.4%
hits_36.vortex 1.0 vortex-file-compressed 68.49 MB 68.20 MB 296.23 KB -0.4%
hits_11.vortex 1.0 vortex-file-compressed 80.01 MB 79.66 MB 355.26 KB -0.4%
hits_82.vortex 1.0 vortex-file-compressed 99.91 MB 99.48 MB 444.33 KB -0.4%
hits_17.vortex 1.0 vortex-file-compressed 87.51 MB 87.12 MB 392.70 KB -0.4%
hits_30.vortex 1.0 vortex-file-compressed 87.19 MB 86.78 MB 421.68 KB -0.5%
hits_34.vortex 1.0 vortex-file-compressed 97.87 MB 97.39 MB 492.03 KB -0.5%
hits_46.vortex 1.0 vortex-file-compressed 69.45 MB 69.11 MB 353.59 KB -0.5%
hits_86.vortex 1.0 vortex-file-compressed 69.39 MB 69.04 MB 358.95 KB -0.5%
hits_19.vortex 1.0 vortex-file-compressed 73.62 MB 73.24 MB 382.05 KB -0.5%
hits_93.vortex 1.0 vortex-file-compressed 90.66 MB 90.20 MB 470.60 KB -0.5%
hits_71.vortex 1.0 vortex-file-compressed 102.05 MB 101.53 MB 532.77 KB -0.5%
hits_4.vortex 1.0 vortex-file-compressed 108.82 MB 108.26 MB 576.86 KB -0.5%
hits_3.vortex 1.0 vortex-file-compressed 142.39 MB 141.65 MB 761.34 KB -0.5%
hits_88.vortex 1.0 vortex-file-compressed 111.50 MB 110.91 MB 598.35 KB -0.5%
hits_40.vortex 1.0 vortex-file-compressed 117.85 MB 117.22 MB 646.47 KB -0.5%
hits_95.vortex 1.0 vortex-file-compressed 96.60 MB 96.05 MB 562.80 KB -0.6%
hits_68.vortex 1.0 vortex-file-compressed 123.42 MB 122.71 MB 723.48 KB -0.6%
hits_43.vortex 1.0 vortex-file-compressed 227.22 MB 225.92 MB 1.30 MB -0.6%
hits_44.vortex 1.0 vortex-file-compressed 187.01 MB 185.92 MB 1.09 MB -0.6%
hits_94.vortex 1.0 vortex-file-compressed 138.84 MB 138.03 MB 827.68 KB -0.6%
hits_37.vortex 1.0 vortex-file-compressed 85.86 MB 85.32 MB 552.85 KB -0.6%
hits_77.vortex 1.0 vortex-file-compressed 168.63 MB 167.56 MB 1.07 MB -0.6%
hits_41.vortex 1.0 vortex-file-compressed 224.07 MB 222.64 MB 1.43 MB -0.6%
hits_18.vortex 1.0 vortex-file-compressed 105.03 MB 104.35 MB 692.61 KB -0.6%
hits_74.vortex 1.0 vortex-file-compressed 120.16 MB 119.38 MB 799.20 KB -0.6%
hits_20.vortex 1.0 vortex-file-compressed 62.95 MB 62.53 MB 428.30 KB -0.7%
hits_42.vortex 1.0 vortex-file-compressed 223.19 MB 221.69 MB 1.50 MB -0.7%
hits_89.vortex 1.0 vortex-file-compressed 184.48 MB 183.20 MB 1.28 MB -0.7%
hits_29.vortex 1.0 vortex-file-compressed 59.81 MB 59.38 MB 441.03 KB -0.7%
hits_76.vortex 1.0 vortex-file-compressed 114.57 MB 113.75 MB 845.06 KB -0.7%
hits_84.vortex 1.0 vortex-file-compressed 117.58 MB 116.73 MB 868.67 KB -0.7%
hits_87.vortex 1.0 vortex-file-compressed 172.54 MB 171.28 MB 1.26 MB -0.7%
hits_49.vortex 1.0 vortex-file-compressed 75.85 MB 75.28 MB 577.92 KB -0.7%
hits_31.vortex 1.0 vortex-file-compressed 90.18 MB 89.45 MB 747.75 KB -0.8%
hits_65.vortex 1.0 vortex-file-compressed 183.83 MB 182.27 MB 1.55 MB -0.8%
hits_26.vortex 1.0 vortex-file-compressed 110.20 MB 109.23 MB 992.92 KB -0.9%
hits_25.vortex 1.0 vortex-file-compressed 114.37 MB 113.34 MB 1.03 MB -0.9%
hits_16.vortex 1.0 vortex-file-compressed 79.97 MB 79.23 MB 760.98 KB -0.9%
hits_67.vortex 1.0 vortex-file-compressed 184.16 MB 182.43 MB 1.73 MB -0.9%
hits_79.vortex 1.0 vortex-file-compressed 145.17 MB 143.80 MB 1.36 MB -0.9%
hits_73.vortex 1.0 vortex-file-compressed 110.47 MB 109.26 MB 1.21 MB -1.1%
hits_1.vortex 1.0 vortex-file-compressed 138.49 MB 136.94 MB 1.55 MB -1.1%
hits_64.vortex 1.0 vortex-file-compressed 81.31 MB 80.37 MB 966.43 KB -1.2%
hits_62.vortex 1.0 vortex-file-compressed 117.62 MB 116.24 MB 1.38 MB -1.2%
hits_98.vortex 1.0 vortex-file-compressed 118.47 MB 117.04 MB 1.43 MB -1.2%
hits_91.vortex 1.0 vortex-file-compressed 97.20 MB 95.99 MB 1.22 MB -1.3%
hits_52.vortex 1.0 vortex-file-compressed 105.13 MB 103.66 MB 1.47 MB -1.4%
hits_2.vortex 1.0 vortex-file-compressed 186.50 MB 183.65 MB 2.85 MB -1.5%
hits_72.vortex 1.0 vortex-file-compressed 84.85 MB 83.53 MB 1.31 MB -1.5%
hits_15.vortex 1.0 vortex-file-compressed 89.32 MB 87.67 MB 1.64 MB -1.8%
hits_53.vortex 1.0 vortex-file-compressed 87.53 MB 85.76 MB 1.78 MB -2.0%
hits_23.vortex 1.0 vortex-file-compressed 77.92 MB 76.33 MB 1.60 MB -2.0%
hits_61.vortex 1.0 vortex-file-compressed 101.28 MB 99.10 MB 2.18 MB -2.2%
hits_24.vortex 1.0 vortex-file-compressed 77.49 MB 75.78 MB 1.70 MB -2.2%
hits_85.vortex 1.0 vortex-file-compressed 91.92 MB 89.83 MB 2.09 MB -2.3%
hits_22.vortex 1.0 vortex-file-compressed 78.63 MB 76.82 MB 1.81 MB -2.3%
hits_21.vortex 1.0 vortex-file-compressed 94.28 MB 91.71 MB 2.58 MB -2.7%
hits_83.vortex 1.0 vortex-file-compressed 89.84 MB 87.37 MB 2.47 MB -2.7%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.05 GB → 7.05 GB (-0.0%)
  • vortex-file-compressed: 11.02 GB → 10.95 GB (-0.6%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +1.2% +3.3% -2.1% +831.7% ➖ noise
0 duckdb:duckdb +14.4% +3.3% +10.7% +276.5% ➖ noise
0 duckdb:vortex-file-compressed +1.7% +3.3% -1.5% +436.4% ➖ noise
1 datafusion:vortex-file-compressed +0.9% -3.1% +4.1% +22.2% ➖ noise
1 duckdb:duckdb +6.6% -3.1% +10.0% +49.5% ➖ noise
1 duckdb:vortex-file-compressed -11.1% -3.1% -8.3% +27.5% ➖ noise
2 datafusion:vortex-file-compressed +14.2% -0.4% +14.7% +25.6% ➖ noise
2 duckdb:duckdb +2.9% -0.4% +3.3% +28.7% ➖ noise
2 duckdb:vortex-file-compressed +1.6% -0.4% +2.0% +14.7% ➖ noise
3 datafusion:vortex-file-compressed +12.2% +7.1% +4.8% +143.9% ➖ noise
3 duckdb:duckdb +3.7% +7.1% -3.1% +62.9% ➖ noise
3 duckdb:vortex-file-compressed +0.8% +7.1% -5.8% +93.4% ➖ noise
4 datafusion:vortex-file-compressed +8.2% +6.4% +1.6% +15.8% ➖ noise
4 duckdb:duckdb +1.2% +6.4% -5.0% +11.8% ➖ noise
4 duckdb:vortex-file-compressed -1.0% +6.4% -7.0% +12.4% ➖ noise
5 datafusion:vortex-file-compressed +11.7% +5.1% +6.3% +12.7% ➖ noise
5 duckdb:duckdb +1.5% +5.1% -3.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.2% +5.1% -3.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +80.3% +7.1% +68.3% +138.8% ➖ noise
6 duckdb:duckdb +6.5% +7.1% -0.6% +16.1% ➖ noise
6 duckdb:vortex-file-compressed -2.2% +7.1% -8.7% +21.6% ➖ noise
7 datafusion:vortex-file-compressed +12.8% +2.1% +10.5% +42.2% ➖ noise
7 duckdb:duckdb +5.1% +2.1% +2.9% +20.1% ➖ noise
7 duckdb:vortex-file-compressed +12.6% +2.1% +10.2% +30.2% ➖ noise
8 datafusion:vortex-file-compressed +9.3% +6.9% +2.2% +13.2% ➖ noise
8 duckdb:duckdb +1.2% +6.9% -5.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.9% +6.9% -8.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +7.8% +4.9% +2.7% +13.3% ➖ noise
9 duckdb:duckdb +1.2% +4.9% -3.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.4% +4.9% -5.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +15.0% -0.3% +15.3% +12.8% 🚨 regression
10 duckdb:duckdb +0.9% -0.3% +1.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.8% -0.3% +3.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +5.9% +8.5% -2.4% +10.0% ➖ noise
11 duckdb:duckdb +2.8% +8.5% -5.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +4.8% +8.5% -3.3% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +8.0% +3.2% +4.6% +10.0% ➖ noise
12 duckdb:duckdb +0.4% +3.2% -2.7% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.1% +3.2% -3.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +4.5% +2.1% +2.4% +10.0% ➖ noise
13 duckdb:duckdb -1.4% +2.1% -3.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.0% +2.1% -2.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +10.8% -0.7% +11.6% +11.1% 🚨 regression
14 duckdb:duckdb +1.3% -0.7% +2.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.3% -0.7% +0.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +4.4% -0.4% +4.9% +10.0% ➖ noise
15 duckdb:duckdb +1.4% -0.4% +1.9% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.4% -0.4% +0.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +2.6% +0.6% +2.0% +10.0% ➖ noise
16 duckdb:duckdb -0.0% +0.6% -0.6% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.9% +0.6% -1.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +2.5% +1.7% +0.8% +10.0% ➖ noise
17 duckdb:duckdb -0.6% +1.7% -2.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.3% +1.7% -2.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +3.7% -0.7% +4.4% +10.0% ➖ noise
18 duckdb:duckdb +0.5% -0.7% +1.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.9% -0.7% -0.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +11.6% -1.3% +13.0% +47.0% ➖ noise
19 duckdb:duckdb +6.2% -1.3% +7.6% +21.5% ➖ noise
19 duckdb:vortex-file-compressed +0.7% -1.3% +2.0% +28.9% ➖ noise
20 datafusion:vortex-file-compressed +4.4% +1.1% +3.3% +110.1% ➖ noise
20 duckdb:duckdb +0.9% +1.1% -0.2% +82.4% ➖ noise
20 duckdb:vortex-file-compressed -4.5% +1.1% -5.6% +38.1% ➖ noise
21 datafusion:vortex-file-compressed +4.9% +1.6% +3.3% +10.0% ➖ noise
21 duckdb:duckdb -0.9% +1.6% -2.5% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.5% +1.6% -1.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +3.0% +1.7% +1.4% +10.0% ➖ noise
22 duckdb:duckdb -3.3% +1.7% -4.9% +39.2% ➖ noise
22 duckdb:vortex-file-compressed +6.6% +1.7% +4.9% +13.0% ➖ noise
23 datafusion:vortex-file-compressed +7.4% +5.7% +1.7% +38.1% ➖ noise
23 duckdb:duckdb -1.5% +5.7% -6.8% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -4.3% +5.7% -9.4% +20.7% ➖ noise
24 datafusion:vortex-file-compressed -0.4% +3.0% -3.3% +16.3% ➖ noise
24 duckdb:duckdb +6.1% +3.0% +2.9% +28.5% ➖ noise
24 duckdb:vortex-file-compressed +1.4% +3.0% -1.6% +14.8% ➖ noise
25 datafusion:vortex-file-compressed +3.8% +5.4% -1.5% +10.2% ➖ noise
25 duckdb:duckdb +1.5% +5.4% -3.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -0.9% +5.4% -6.0% +15.6% ➖ noise
26 datafusion:vortex-file-compressed +10.4% +3.1% +7.0% +15.3% ➖ noise
26 duckdb:duckdb +2.6% +3.1% -0.5% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +5.2% +3.1% +2.0% +20.5% ➖ noise
27 datafusion:vortex-file-compressed +11.5% +3.8% +7.4% +10.0% ➖ noise
27 duckdb:duckdb -0.2% +3.8% -3.9% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +0.7% +3.8% -3.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +4.6% +0.2% +4.4% +10.0% ➖ noise
28 duckdb:duckdb -0.2% +0.2% -0.5% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +1.4% +0.2% +1.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +0.1% +1.3% -1.2% +10.0% ➖ noise
29 duckdb:duckdb +2.4% +1.3% +1.1% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +1.0% +1.3% -0.3% +43.0% ➖ noise
30 datafusion:vortex-file-compressed +7.0% +1.6% +5.3% +11.6% ➖ noise
30 duckdb:duckdb +2.3% +1.6% +0.7% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.5% +1.6% -1.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +10.1% +4.0% +5.9% +10.0% ➖ noise
31 duckdb:duckdb -0.9% +4.0% -4.7% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +1.3% +4.0% -2.6% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +12.9% +4.2% +8.3% +10.0% ➖ noise
32 duckdb:duckdb -1.1% +4.2% -5.1% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -0.3% +4.2% -4.4% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +8.9% +1.1% +7.7% +10.0% ➖ noise
33 duckdb:duckdb -0.8% +1.1% -1.9% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -3.7% +1.1% -4.8% +15.6% ➖ noise
34 datafusion:vortex-file-compressed +2.4% +1.7% +0.7% +10.0% ➖ noise
34 duckdb:duckdb -1.1% +1.7% -2.8% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -1.8% +1.7% -3.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -1.9% +2.4% -4.2% +10.0% ➖ noise
35 duckdb:duckdb +0.1% +2.4% -2.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.0% +2.4% -2.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +5.0% -3.7% +9.0% +10.6% ➖ noise
36 duckdb:duckdb +4.6% -3.7% +8.7% +15.5% ➖ noise
36 duckdb:vortex-file-compressed -2.4% -3.7% +1.3% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +2.8% +1.5% +1.3% +11.2% ➖ noise
37 duckdb:duckdb +9.9% +1.5% +8.3% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -5.8% +1.5% -7.2% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +0.1% +1.4% -1.2% +16.2% ➖ noise
38 duckdb:duckdb +7.1% +1.4% +5.6% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +1.0% +1.4% -0.4% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -1.3% +4.7% -5.7% +11.7% ➖ noise
39 duckdb:duckdb -12.5% +4.7% -16.4% +23.8% ➖ noise
39 duckdb:vortex-file-compressed +5.1% +4.7% +0.4% +15.5% ➖ noise
40 datafusion:vortex-file-compressed +0.4% +2.8% -2.3% +20.0% ➖ noise
40 duckdb:duckdb +6.3% +2.8% +3.4% +13.3% ➖ noise
40 duckdb:vortex-file-compressed +1.7% +2.8% -1.0% +20.7% ➖ noise
41 datafusion:vortex-file-compressed +1.9% +4.4% -2.4% +17.6% ➖ noise
41 duckdb:duckdb +8.4% +4.4% +3.8% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -5.9% +4.4% -9.9% +10.0% ✅ faster
42 datafusion:vortex-file-compressed +3.0% +5.3% -2.2% +12.3% ➖ noise
42 duckdb:duckdb +7.5% +5.3% +2.0% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -7.0% +5.3% -11.7% +15.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-3.3%, low confidence) · DuckDB No clear signal (+1.3%, low confidence)
Vortex (geomean): 0.938x ➖
Parquet (geomean): 0.947x ➖
Shifts: Parquet (control) -5.3% · Median polish -3.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.914x ➖, 2↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 🚀 129693271 152425926 0.85
appian_q02/datafusion:vortex-file-compressed 668681906 701014253 0.95
appian_q03/datafusion:vortex-file-compressed 360048476 383695950 0.94
appian_q04/datafusion:vortex-file-compressed 27506418055 30375142468 0.91
appian_q05/datafusion:vortex-file-compressed 257140017 281513047 0.91
appian_q06/datafusion:vortex-file-compressed 423616905 447407023 0.95
appian_q07/datafusion:vortex-file-compressed 🚀 451622325 517149513 0.87
appian_q08/datafusion:vortex-file-compressed 1851831367 1988606346 0.93
datafusion / parquet (0.945x ➖, 1↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 🚀 126949561 143614406 0.88
appian_q02/datafusion:parquet 668720208 699165773 0.96
appian_q03/datafusion:parquet 354952534 369492326 0.96
appian_q04/datafusion:parquet 27418581358 29993434864 0.91
appian_q05/datafusion:parquet 291882293 300791687 0.97
appian_q06/datafusion:parquet 434219093 450387923 0.96
appian_q07/datafusion:parquet 449674969 466819645 0.96
appian_q08/datafusion:parquet 1840010460 1934873341 0.95
duckdb / vortex-file-compressed (0.962x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 195800251 207350552 0.94
appian_q02/duckdb:vortex-file-compressed 621114331 635554447 0.98
appian_q03/duckdb:vortex-file-compressed 266595330 282608043 0.94
appian_q04/duckdb:vortex-file-compressed 1330079759 1355828774 0.98
appian_q05/duckdb:vortex-file-compressed 292055434 309078003 0.94
appian_q06/duckdb:vortex-file-compressed 806113736 810043381 1.00
appian_q07/duckdb:vortex-file-compressed 344543553 364483349 0.95
appian_q08/duckdb:vortex-file-compressed 1306253875 1348953767 0.97
duckdb / parquet (0.950x ➖, 1↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 🚀 203220571 227092168 0.89
appian_q02/duckdb:parquet 604969750 647945537 0.93
appian_q03/duckdb:parquet 284745300 309218825 0.92
appian_q04/duckdb:parquet 1323129213 1347629051 0.98
appian_q05/duckdb:parquet 317837354 326269415 0.97
appian_q06/duckdb:parquet 797146222 807475282 0.99
appian_q07/duckdb:parquet 359716648 377640084 0.95
appian_q08/duckdb:parquet 1262707390 1320328149 0.96
duckdb / duckdb (0.961x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 171447825 185904950 0.92
appian_q02/duckdb:duckdb 547978676 562292674 0.97
appian_q03/duckdb:duckdb 386318955 384258080 1.01
appian_q04/duckdb:duckdb 1302253305 1330490952 0.98
appian_q05/duckdb:duckdb 281180079 305762248 0.92
appian_q06/duckdb:duckdb 786295766 793465070 0.99
appian_q07/duckdb:duckdb 325121309 343589114 0.95
appian_q08/duckdb:duckdb 1221674983 1278028026 0.96
File Size Changes (6 files changed, -4.8% overall, 2↑ 4↓)
File Scale Format Base HEAD Change %
customerview.vortex 1.0 vortex-file-compressed 19.91 MB 19.97 MB +70.57 KB +0.3%
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB +32 B +0.0%
creditcardview.vortex 1.0 vortex-file-compressed 61.03 MB 58.29 MB 2.75 MB -4.5%
orderview.vortex 1.0 vortex-file-compressed 81.10 MB 76.16 MB 4.94 MB -6.1%
orderitemview.vortex 1.0 vortex-file-compressed 294.88 MB 265.21 MB 29.67 MB -10.1%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 513.76 MB → 476.48 MB (-7.3%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-file-compressed -14.9% -11.1% -4.3% +10.0% ➖ noise
1 duckdb:duckdb -7.8% -11.1% +3.7% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -5.6% -11.1% +6.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -4.6% -5.5% +0.9% +10.0% ➖ noise
2 duckdb:duckdb -2.5% -5.5% +3.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.3% -5.5% +3.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -6.2% -5.9% -0.2% +10.0% ➖ noise
3 duckdb:duckdb +0.5% -5.9% +6.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -5.7% -5.9% +0.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -9.4% -5.3% -4.4% +10.0% ➖ noise
4 duckdb:duckdb -2.1% -5.3% +3.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.9% -5.3% +3.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -8.7% -2.8% -6.1% +13.8% ➖ noise
5 duckdb:duckdb -8.0% -2.8% -5.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -5.5% -2.8% -2.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -5.3% -2.4% -2.9% +10.0% ➖ noise
6 duckdb:duckdb -0.9% -2.4% +1.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.5% -2.4% +2.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -12.7% -4.2% -8.8% +10.0% ➖ noise
7 duckdb:duckdb -5.4% -4.2% -1.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.5% -4.2% -1.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -6.9% -4.6% -2.4% +10.0% ➖ noise
8 duckdb:duckdb -4.4% -4.6% +0.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.2% -4.6% +1.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: Compression

Vortex (geomean): 0.997x ➖
Parquet (geomean): 0.990x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.986x ➖, 8↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
compress time/Arade 1112388863 1084032887 1.03
compress time/Bimbo 5673812254 5687546755 1.00
compress time/CMSprovider 2792307585 2786177947 1.00
compress time/Euro2016 497313436 475028369 1.05
compress time/Food 384392378 380415168 1.01
compress time/HashTags 876017295 869121595 1.01
compress time/TPC-H l_comment canonical 1227108610 1281139958 0.96
compress time/TPC-H l_comment chunked 1226439278 1213602888 1.01
compress time/taxi 674991007 678589770 0.99
compress time/wide table cols=100 chunks=1 rows=1000 11323080 12548653 0.90
compress time/wide table cols=100 chunks=50 rows=1000 🚀 11481630 12837415 0.89
compress time/wide table cols=1000 chunks=1 rows=1000 🚀 123861256 140066761 0.88
compress time/wide table cols=1000 chunks=50 rows=1000 129474081 138862473 0.93
compress time/wide table cols=10000 chunks=1 rows=1000 1451471725 1586834505 0.91
compress time/wide table cols=10000 chunks=50 rows=1000 1455492279 1445000047 1.01
decompress time/Arade 28201631 26330187 1.07
decompress time/Bimbo 76918499 76546085 1.00
decompress time/CMSprovider 78159566 76028192 1.03
decompress time/Euro2016 20036753 19436205 1.03
decompress time/Food 8124516 7961977 1.02
decompress time/HashTags 87586995 87169075 1.00
decompress time/TPC-H l_comment canonical 39585440 43000595 0.92
decompress time/TPC-H l_comment chunked 41055589 39423814 1.04
decompress time/taxi 14618301 14941521 0.98
decompress time/wide table cols=100 chunks=1 rows=1000 2571050 2604498 0.99
decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2587460 3024350 0.86
decompress time/wide table cols=1000 chunks=1 rows=1000 23446782 24314547 0.96
decompress time/wide table cols=1000 chunks=50 rows=1000 24087967 26053890 0.92
decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 252559929 310613186 0.81
decompress time/wide table cols=10000 chunks=50 rows=1000 250637153 251319386 1.00
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2615660824 2591300176 1.01
parquet_rs-zstd compress time/Bimbo 12964537967 12713537150 1.02
parquet_rs-zstd compress time/CMSprovider 6986285984 6999595747 1.00
parquet_rs-zstd compress time/Euro2016 1310428279 1323016213 0.99
parquet_rs-zstd compress time/Food 817865908 801544613 1.02
parquet_rs-zstd compress time/HashTags 2182242903 2159032256 1.01
parquet_rs-zstd compress time/TPC-H l_comment canonical 3199091568 3224573194 0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked 3201185856 3230399485 0.99
parquet_rs-zstd compress time/taxi 1198901162 1182732944 1.01
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 6197023 7116432 0.87
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 6321409 7771563 0.81
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 74561396 77368104 0.96
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 74805232 82011091 0.91
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 804042783 827126317 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 804891579 850764939 0.95
parquet_rs-zstd decompress time/Arade 618118959 620505002 1.00
parquet_rs-zstd decompress time/Bimbo 1714181635 1708412532 1.00
parquet_rs-zstd decompress time/CMSprovider 1699653852 1700302508 1.00
parquet_rs-zstd decompress time/Euro2016 376263393 374851611 1.00
parquet_rs-zstd decompress time/Food 196604127 199608850 0.98
parquet_rs-zstd decompress time/HashTags 631804625 629673477 1.00
parquet_rs-zstd decompress time/TPC-H l_comment canonical 587761913 584704111 1.01
parquet_rs-zstd decompress time/TPC-H l_comment chunked 589087191 588242456 1.00
parquet_rs-zstd decompress time/taxi 245797792 242844486 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2925682 2937254 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2919066 3323044 0.88
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32951360 34386868 0.96
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33591162 36925586 0.91
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 356743462 366566319 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 360986027 370340760 0.97
vortex-file-compressed size/Arade 145359060 145363860 1.00
vortex-file-compressed size/Bimbo 467259636 468763396 1.00
vortex-file-compressed size/CMSprovider 417827692 417905428 1.00
vortex-file-compressed size/Euro2016 157463164 159011372 0.99
vortex-file-compressed size/Food 41977344 41927000 1.00
vortex-file-compressed size/HashTags 184982276 185460580 1.00
vortex-file-compressed size/TPC-H l_comment canonical 171991448 178509712 0.96
vortex-file-compressed size/TPC-H l_comment chunked 171933816 178431936 0.96
vortex-file-compressed size/taxi 52292908 52364012 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.02
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.98
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.06
vortex:parquet-zstd ratio compress time/Food 0 0 0.99
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.97
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio compress time/taxi 0 0 0.98
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.10
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.92
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.94
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.06
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.08
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.00
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.03
vortex:parquet-zstd ratio decompress time/Food 0 0 1.04
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.00
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.92
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.04
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 0 0 0.84
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.02
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 0.99
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 0.96
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 0.96
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@joseph-isaacs joseph-isaacs requested a review from robert3005 June 2, 2026 11:34
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.9%
Engines: DataFusion No clear signal (-0.8%, environment too noisy confidence) · DuckDB No clear signal (-14.5%, environment too noisy confidence)
Vortex (geomean): 0.877x ➖
Parquet (geomean): 0.953x ➖
Shifts: Parquet (control) -4.7% · Median polish -5.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.953x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 676154513 681328486 0.99
tpch_q02/datafusion:vortex-file-compressed 798020643 741056901 1.08
tpch_q03/datafusion:vortex-file-compressed 720306034 815436644 0.88
tpch_q04/datafusion:vortex-file-compressed 496391534 612103981 0.81
tpch_q05/datafusion:vortex-file-compressed 853457248 914592846 0.93
tpch_q06/datafusion:vortex-file-compressed 580008557 583709354 0.99
tpch_q07/datafusion:vortex-file-compressed 941908830 1024913904 0.92
tpch_q08/datafusion:vortex-file-compressed 1102956957 1231867665 0.90
tpch_q09/datafusion:vortex-file-compressed 1256213938 1278748567 0.98
tpch_q10/datafusion:vortex-file-compressed 809870504 917617680 0.88
tpch_q11/datafusion:vortex-file-compressed 489286220 498870034 0.98
tpch_q12/datafusion:vortex-file-compressed 792347070 857026580 0.92
tpch_q13/datafusion:vortex-file-compressed 403266992 447077210 0.90
tpch_q14/datafusion:vortex-file-compressed 603681097 569597137 1.06
tpch_q15/datafusion:vortex-file-compressed 906530779 924999245 0.98
tpch_q16/datafusion:vortex-file-compressed 415538938 391939637 1.06
tpch_q17/datafusion:vortex-file-compressed 1264314424 1270961460 0.99
tpch_q18/datafusion:vortex-file-compressed 1151271273 1239611624 0.93
tpch_q19/datafusion:vortex-file-compressed 820920831 858367154 0.96
tpch_q20/datafusion:vortex-file-compressed 828348912 847787779 0.98
tpch_q21/datafusion:vortex-file-compressed 1471668499 1624003464 0.91
tpch_q22/datafusion:vortex-file-compressed 383262577 393580800 0.97
datafusion / vortex-compact (1.018x ➖, 0↑ 1↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 672026366 703273425 0.96
tpch_q02/datafusion:vortex-compact 747375263 694375481 1.08
tpch_q03/datafusion:vortex-compact 731214052 713609989 1.02
tpch_q04/datafusion:vortex-compact 500590233 556893814 0.90
tpch_q05/datafusion:vortex-compact 852041863 860498143 0.99
tpch_q06/datafusion:vortex-compact 564325288 507408482 1.11
tpch_q07/datafusion:vortex-compact 1011818052 959959925 1.05
tpch_q08/datafusion:vortex-compact 1130523630 1204414858 0.94
tpch_q09/datafusion:vortex-compact 1208941252 1309408025 0.92
tpch_q10/datafusion:vortex-compact 845072663 942267649 0.90
tpch_q11/datafusion:vortex-compact 444199216 406388866 1.09
tpch_q12/datafusion:vortex-compact 756653301 729043924 1.04
tpch_q13/datafusion:vortex-compact 404292105 427774230 0.95
tpch_q14/datafusion:vortex-compact 493984033 506076048 0.98
tpch_q15/datafusion:vortex-compact 930321533 978150236 0.95
tpch_q16/datafusion:vortex-compact 🚨 468103917 342350126 1.37
tpch_q17/datafusion:vortex-compact 1221095492 1159210120 1.05
tpch_q18/datafusion:vortex-compact 1101082805 1162477896 0.95
tpch_q19/datafusion:vortex-compact 796287977 771861999 1.03
tpch_q20/datafusion:vortex-compact 894771531 812466876 1.10
tpch_q21/datafusion:vortex-compact 1344435767 1383454426 0.97
tpch_q22/datafusion:vortex-compact 393732517 339851645 1.16
datafusion / parquet (0.993x ➖, 1↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 840542949 815355718 1.03
tpch_q02/datafusion:parquet 958480973 738823329 1.30
tpch_q03/datafusion:parquet 982063930 942283784 1.04
tpch_q04/datafusion:parquet 518361061 447953223 1.16
tpch_q05/datafusion:parquet 1105964402 1103774926 1.00
tpch_q06/datafusion:parquet 526919587 508241014 1.04
tpch_q07/datafusion:parquet 1340031682 1247069185 1.07
tpch_q08/datafusion:parquet 1831340127 1557029906 1.18
tpch_q09/datafusion:parquet 1837293025 1878052663 0.98
tpch_q10/datafusion:parquet 1987730842 2000387253 0.99
tpch_q11/datafusion:parquet 453378140 590994505 0.77
tpch_q12/datafusion:parquet 662350218 645148079 1.03
tpch_q13/datafusion:parquet 674072839 698462629 0.97
tpch_q14/datafusion:parquet 804054290 811949675 0.99
tpch_q15/datafusion:parquet 1314506984 1387480551 0.95
tpch_q16/datafusion:parquet 505233893 455947048 1.11
tpch_q17/datafusion:parquet 1367780072 1414956101 0.97
tpch_q18/datafusion:parquet 1565883646 1503321805 1.04
tpch_q19/datafusion:parquet 854632647 987915464 0.87
tpch_q20/datafusion:parquet 🚀 1044189201 1557476806 0.67
tpch_q21/datafusion:parquet 1634672599 1796139230 0.91
tpch_q22/datafusion:parquet 659003675 660019040 1.00
duckdb / vortex-file-compressed (0.802x ➖, 1↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 597373440 647251375 0.92
tpch_q02/duckdb:vortex-file-compressed 1168208063 1421738936 0.82
tpch_q03/duckdb:vortex-file-compressed 836094318 1074805438 0.78
tpch_q04/duckdb:vortex-file-compressed 607576392 700998580 0.87
tpch_q05/duckdb:vortex-file-compressed 1086015350 1310147366 0.83
tpch_q06/duckdb:vortex-file-compressed 582885117 564086572 1.03
tpch_q07/duckdb:vortex-file-compressed 1191411328 1485944024 0.80
tpch_q08/duckdb:vortex-file-compressed 1354903457 1701084234 0.80
tpch_q09/duckdb:vortex-file-compressed 1554431634 1894469130 0.82
tpch_q10/duckdb:vortex-file-compressed 1118435627 1375113967 0.81
tpch_q11/duckdb:vortex-file-compressed 646015758 757492862 0.85
tpch_q12/duckdb:vortex-file-compressed 1127204475 1471938556 0.77
tpch_q13/duckdb:vortex-file-compressed 816213779 1124285381 0.73
tpch_q14/duckdb:vortex-file-compressed 631814208 825033428 0.77
tpch_q15/duckdb:vortex-file-compressed 526084921 735303627 0.72
tpch_q16/duckdb:vortex-file-compressed 479671511 665809383 0.72
tpch_q17/duckdb:vortex-file-compressed 925287175 1281383479 0.72
tpch_q18/duckdb:vortex-file-compressed 🚀 834036800 1191946895 0.70
tpch_q19/duckdb:vortex-file-compressed 731575152 895547709 0.82
tpch_q20/duckdb:vortex-file-compressed 1243575433 1494340953 0.83
tpch_q21/duckdb:vortex-file-compressed 1696017488 2259782489 0.75
tpch_q22/duckdb:vortex-file-compressed 469166185 545168993 0.86
duckdb / vortex-compact (0.762x ➖, 4↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 593766843 694403132 0.86
tpch_q02/duckdb:vortex-compact 1082961365 1327125937 0.82
tpch_q03/duckdb:vortex-compact 864807410 1026097857 0.84
tpch_q04/duckdb:vortex-compact 547321045 605273109 0.90
tpch_q05/duckdb:vortex-compact 1147715536 1359150880 0.84
tpch_q06/duckdb:vortex-compact 502489088 679141642 0.74
tpch_q07/duckdb:vortex-compact 1038089239 1478892206 0.70
tpch_q08/duckdb:vortex-compact 1349570620 1585644966 0.85
tpch_q09/duckdb:vortex-compact 1516087627 1885175996 0.80
tpch_q10/duckdb:vortex-compact 1079406731 1465504800 0.74
tpch_q11/duckdb:vortex-compact 651660161 775791023 0.84
tpch_q12/duckdb:vortex-compact 1037797460 1357493149 0.76
tpch_q13/duckdb:vortex-compact 794276968 1016354836 0.78
tpch_q14/duckdb:vortex-compact 592082348 828402684 0.71
tpch_q15/duckdb:vortex-compact 518410000 603860462 0.86
tpch_q16/duckdb:vortex-compact 397710654 515519415 0.77
tpch_q17/duckdb:vortex-compact 🚀 828565384 1283427106 0.65
tpch_q18/duckdb:vortex-compact 723847298 1018976312 0.71
tpch_q19/duckdb:vortex-compact 751753938 973316097 0.77
tpch_q20/duckdb:vortex-compact 🚀 1133683100 1786367188 0.63
tpch_q21/duckdb:vortex-compact 🚀 1647812626 2379361304 0.69
tpch_q22/duckdb:vortex-compact 🚀 416777195 726894635 0.57
duckdb / parquet (0.914x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 835628861 836671628 1.00
tpch_q02/duckdb:parquet 1141804070 1379815428 0.83
tpch_q03/duckdb:parquet 1642141910 1555701635 1.06
tpch_q04/duckdb:parquet 978207557 1094229008 0.89
tpch_q05/duckdb:parquet 1743410063 1974933061 0.88
tpch_q06/duckdb:parquet 754128989 766439471 0.98
tpch_q07/duckdb:parquet 1703295667 1793363421 0.95
tpch_q08/duckdb:parquet 2288938178 2470783374 0.93
tpch_q09/duckdb:parquet 2434369470 2467920325 0.99
tpch_q10/duckdb:parquet 2852005172 2939241337 0.97
tpch_q11/duckdb:parquet 833158239 963834698 0.86
tpch_q12/duckdb:parquet 1233692187 1075667854 1.15
tpch_q13/duckdb:parquet 1142648624 1211924181 0.94
tpch_q14/duckdb:parquet 1236089648 1288178818 0.96
tpch_q15/duckdb:parquet 841882012 942417082 0.89
tpch_q16/duckdb:parquet 892007367 997258661 0.89
tpch_q17/duckdb:parquet 1270287949 1358147233 0.94
tpch_q18/duckdb:parquet 1439315571 1857866979 0.77
tpch_q19/duckdb:parquet 1435230826 1729279117 0.83
tpch_q20/duckdb:parquet 1748838592 2301942480 0.76
tpch_q21/duckdb:parquet 1708867005 2044906230 0.84
tpch_q22/duckdb:parquet 1071350833 1207493257 0.89
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -4.4% +1.5% -5.8% +48.7% ➖ noise
1 datafusion:vortex-file-compressed -0.8% +1.5% -2.2% +53.0% ➖ noise
1 duckdb:vortex-compact -14.5% +1.5% -15.7% +41.3% ➖ noise
1 duckdb:vortex-file-compressed -7.7% +1.5% -9.0% +42.4% ➖ noise
2 datafusion:vortex-compact +7.6% +3.6% +3.9% +35.9% ➖ noise
2 datafusion:vortex-file-compressed +7.7% +3.6% +3.9% +33.4% ➖ noise
2 duckdb:vortex-compact -18.4% +3.6% -21.2% +32.1% ➖ noise
2 duckdb:vortex-file-compressed -17.8% +3.6% -20.7% +30.7% ➖ noise
3 datafusion:vortex-compact +2.5% +4.9% -2.3% +44.5% ➖ noise
3 datafusion:vortex-file-compressed -11.7% +4.9% -15.8% +48.7% ➖ noise
3 duckdb:vortex-compact -15.7% +4.9% -19.6% +42.0% ➖ noise
3 duckdb:vortex-file-compressed -22.2% +4.9% -25.8% +38.0% ➖ noise
4 datafusion:vortex-compact -10.1% +1.7% -11.6% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -18.9% +1.7% -20.3% +30.0% ➖ noise
4 duckdb:vortex-compact -9.6% +1.7% -11.1% +32.5% ➖ noise
4 duckdb:vortex-file-compressed -13.3% +1.7% -14.8% +30.0% ➖ noise
5 datafusion:vortex-compact -1.0% -6.0% +5.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -6.7% -6.0% -0.8% +30.0% ➖ noise
5 duckdb:vortex-compact -15.6% -6.0% -10.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -17.1% -6.0% -11.9% +30.0% ➖ noise
6 datafusion:vortex-compact +11.2% +1.0% +10.1% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -0.6% +1.0% -1.6% +30.0% ➖ noise
6 duckdb:vortex-compact -26.0% +1.0% -26.7% +30.0% ✅ faster
6 duckdb:vortex-file-compressed +3.3% +1.0% +2.3% +30.0% ➖ noise
7 datafusion:vortex-compact +5.4% +1.0% +4.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -8.1% +1.0% -9.0% +30.0% ➖ noise
7 duckdb:vortex-compact -29.8% +1.0% -30.5% +30.0% ✅ faster
7 duckdb:vortex-file-compressed -19.8% +1.0% -20.6% +30.0% ➖ noise
8 datafusion:vortex-compact -6.1% +4.4% -10.1% +30.4% ➖ noise
8 datafusion:vortex-file-compressed -10.5% +4.4% -14.2% +30.0% ➖ noise
8 duckdb:vortex-compact -14.9% +4.4% -18.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -20.4% +4.4% -23.7% +30.0% ✅ faster
9 datafusion:vortex-compact -7.7% -1.8% -6.0% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -1.8% -1.8% +0.0% +30.0% ➖ noise
9 duckdb:vortex-compact -19.6% -1.8% -18.1% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -17.9% -1.8% -16.5% +30.0% ➖ noise
10 datafusion:vortex-compact -10.3% -1.8% -8.7% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -11.7% -1.8% -10.1% +30.0% ➖ noise
10 duckdb:vortex-compact -26.3% -1.8% -25.0% +30.0% ✅ faster
10 duckdb:vortex-file-compressed -18.7% -1.8% -17.2% +31.5% ➖ noise
11 datafusion:vortex-compact +9.3% -18.6% +34.2% +30.0% 🚨 regression
11 datafusion:vortex-file-compressed -1.9% -18.6% +20.4% +30.0% ➖ noise
11 duckdb:vortex-compact -16.0% -18.6% +3.2% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -14.7% -18.6% +4.7% +30.0% ➖ noise
12 datafusion:vortex-compact +3.8% +8.5% -4.4% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -7.5% +8.5% -14.8% +30.0% ➖ noise
12 duckdb:vortex-compact -23.6% +8.5% -29.5% +30.0% ✅ faster
12 duckdb:vortex-file-compressed -23.4% +8.5% -29.4% +30.0% ✅ faster
13 datafusion:vortex-compact -5.5% -4.6% -0.9% +30.0% ➖ noise
13 datafusion:vortex-file-compressed -9.8% -4.6% -5.4% +30.4% ➖ noise
13 duckdb:vortex-compact -21.9% -4.6% -18.1% +32.9% ➖ noise
13 duckdb:vortex-file-compressed -27.4% -4.6% -23.9% +30.6% ✅ faster
14 datafusion:vortex-compact -2.4% -2.5% +0.1% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +6.0% -2.5% +8.7% +30.0% ➖ noise
14 duckdb:vortex-compact -28.5% -2.5% -26.7% +30.0% ✅ faster
14 duckdb:vortex-file-compressed -23.4% -2.5% -21.4% +43.6% ➖ noise
15 datafusion:vortex-compact -4.9% -8.0% +3.4% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -2.0% -8.0% +6.5% +30.0% ➖ noise
15 duckdb:vortex-compact -14.2% -8.0% -6.7% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -28.5% -8.0% -22.2% +30.0% ➖ noise
16 datafusion:vortex-compact +36.7% -0.4% +37.3% +36.6% 🚨 regression
16 datafusion:vortex-file-compressed +6.0% -0.4% +6.5% +30.0% ➖ noise
16 duckdb:vortex-compact -22.9% -0.4% -22.5% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -28.0% -0.4% -27.6% +30.0% ✅ faster
17 datafusion:vortex-compact +5.3% -4.9% +10.8% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -0.5% -4.9% +4.6% +30.0% ➖ noise
17 duckdb:vortex-compact -35.4% -4.9% -32.1% +30.0% ✅ faster
17 duckdb:vortex-file-compressed -27.8% -4.9% -24.1% +30.0% ✅ faster
18 datafusion:vortex-compact -5.3% -10.2% +5.4% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -7.1% -10.2% +3.4% +30.0% ➖ noise
18 duckdb:vortex-compact -29.0% -10.2% -20.9% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -30.0% -10.2% -22.1% +30.0% ➖ noise
19 datafusion:vortex-compact +3.2% -15.3% +21.8% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -4.4% -15.3% +12.9% +30.0% ➖ noise
19 duckdb:vortex-compact -22.8% -15.3% -8.8% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -18.3% -15.3% -3.6% +30.0% ➖ noise
20 datafusion:vortex-compact +10.1% -28.6% +54.3% +30.0% 🚨 regression
20 datafusion:vortex-file-compressed -2.3% -28.6% +36.9% +30.0% 🚨 regression
20 duckdb:vortex-compact -36.5% -28.6% -11.1% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -16.8% -28.6% +16.6% +30.0% ➖ noise
21 datafusion:vortex-compact -2.8% -12.8% +11.4% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -9.4% -12.8% +3.9% +30.0% ➖ noise
21 duckdb:vortex-compact -30.7% -12.8% -20.6% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -24.9% -12.8% -13.9% +30.0% ➖ noise
22 datafusion:vortex-compact +15.9% -5.9% +23.1% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -2.6% -5.9% +3.5% +30.0% ➖ noise
22 duckdb:vortex-compact -42.7% -5.9% -39.1% +30.0% ✅ faster
22 duckdb:vortex-file-compressed -13.9% -5.9% -8.6% +30.0% ➖ noise

@joseph-isaacs joseph-isaacs added the changelog/feature A new feature label Jun 2, 2026
@claude
Fix CI for Delta scheme: large-file test data and GPU-incompatible ex…
ffa701a 
…clusion

Enabling Delta in the default scheme set under `--all-features` (which turns
on `unstable_encodings`) changed two things that CI caught:

- `vortex-file open::tests::test_initial_read_size` built a "large" file from
  an alternating `i / -i` pattern, which Delta compresses to ~400KB and trips
  the `> 1MB` assertion. Switch to high-entropy pseudo-random values so the
  file stays large under any encoding. This was the only failure in both the
  coverage and CUDA test jobs.

- `only_cuda_compatible()` must not emit Delta: there is no GPU decode kernel
  for it and its prefix-sum decode is inherently sequential, so exclude it from
  the CUDA-compatible scheme set, like RLE/Sparse/FSST.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (-1.0%, environment too noisy confidence) · DuckDB No clear signal (-1.6%, environment too noisy confidence)
Vortex (geomean): 0.950x ➖
Parquet (geomean): 0.963x ➖
Shifts: Parquet (control) -3.7% · Median polish -3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.924x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 265837984 270912636 0.98
tpch_q02/datafusion:vortex-file-compressed 489749538 594101753 0.82
tpch_q03/datafusion:vortex-file-compressed 389412629 464053205 0.84
tpch_q04/datafusion:vortex-file-compressed 251628006 311607196 0.81
tpch_q05/datafusion:vortex-file-compressed 427652778 455004320 0.94
tpch_q06/datafusion:vortex-file-compressed 317597859 316912894 1.00
tpch_q07/datafusion:vortex-file-compressed 434250133 440797182 0.99
tpch_q08/datafusion:vortex-file-compressed 605522127 610229818 0.99
tpch_q09/datafusion:vortex-file-compressed 446128663 502438712 0.89
tpch_q10/datafusion:vortex-file-compressed 442695568 619154944 0.71
tpch_q11/datafusion:vortex-file-compressed 267806863 321226210 0.83
tpch_q12/datafusion:vortex-file-compressed 410469086 437988028 0.94
tpch_q13/datafusion:vortex-file-compressed 174897267 153412235 1.14
tpch_q14/datafusion:vortex-file-compressed 297083137 242911149 1.22
tpch_q15/datafusion:vortex-file-compressed 447220214 539002124 0.83
tpch_q16/datafusion:vortex-file-compressed 198862196 216158270 0.92
tpch_q17/datafusion:vortex-file-compressed 467243373 414947035 1.13
tpch_q18/datafusion:vortex-file-compressed 336189200 350142000 0.96
tpch_q19/datafusion:vortex-file-compressed 512216725 501506670 1.02
tpch_q20/datafusion:vortex-file-compressed 451612662 469881113 0.96
tpch_q21/datafusion:vortex-file-compressed 585816412 673573447 0.87
tpch_q22/datafusion:vortex-file-compressed 107883944 149859874 0.72
datafusion / vortex-compact (0.979x ➖, 1↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 267398542 270347753 0.99
tpch_q02/datafusion:vortex-compact 🚀 439962600 688917115 0.64
tpch_q03/datafusion:vortex-compact 389704513 411498313 0.95
tpch_q04/datafusion:vortex-compact 219147079 226498527 0.97
tpch_q05/datafusion:vortex-compact 420133993 422850854 0.99
tpch_q06/datafusion:vortex-compact 361493620 422892646 0.85
tpch_q07/datafusion:vortex-compact 505643573 481091984 1.05
tpch_q08/datafusion:vortex-compact 608089501 604708624 1.01
tpch_q09/datafusion:vortex-compact 473921042 503374500 0.94
tpch_q10/datafusion:vortex-compact 597060049 504930370 1.18
tpch_q11/datafusion:vortex-compact 301240013 301162606 1.00
tpch_q12/datafusion:vortex-compact 479958308 447964443 1.07
tpch_q13/datafusion:vortex-compact 143289421 168560862 0.85
tpch_q14/datafusion:vortex-compact 276774056 324154053 0.85
tpch_q15/datafusion:vortex-compact 518066392 510561284 1.01
tpch_q16/datafusion:vortex-compact 191042287 222131704 0.86
tpch_q17/datafusion:vortex-compact 409796642 366588906 1.12
tpch_q18/datafusion:vortex-compact 306097995 316996211 0.97
tpch_q19/datafusion:vortex-compact 564144889 490740797 1.15
tpch_q20/datafusion:vortex-compact 475517035 429807588 1.11
tpch_q21/datafusion:vortex-compact 589870095 523780628 1.13
tpch_q22/datafusion:vortex-compact 132934614 128715933 1.03
datafusion / parquet (0.961x ➖, 1↑ 1↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 233901029 345798827 0.68
tpch_q02/datafusion:parquet 447404750 459668667 0.97
tpch_q03/datafusion:parquet 326214125 420606820 0.78
tpch_q04/datafusion:parquet 221431500 196499216 1.13
tpch_q05/datafusion:parquet 530246346 478333575 1.11
tpch_q06/datafusion:parquet 🚨 227570294 172254566 1.32
tpch_q07/datafusion:parquet 473867216 492852450 0.96
tpch_q08/datafusion:parquet 615048813 699284072 0.88
tpch_q09/datafusion:parquet 474858655 532661581 0.89
tpch_q10/datafusion:parquet 528924840 481953907 1.10
tpch_q11/datafusion:parquet 316608345 319851736 0.99
tpch_q12/datafusion:parquet 227889816 259259375 0.88
tpch_q13/datafusion:parquet 427231775 427946037 1.00
tpch_q14/datafusion:parquet 189952895 168068236 1.13
tpch_q15/datafusion:parquet 308404248 308855518 1.00
tpch_q16/datafusion:parquet 181880875 194493001 0.94
tpch_q17/datafusion:parquet 453153850 370505626 1.22
tpch_q18/datafusion:parquet 482437565 444173596 1.09
tpch_q19/datafusion:parquet 319324269 385021699 0.83
tpch_q20/datafusion:parquet 324893988 363108523 0.89
tpch_q21/datafusion:parquet 550713703 583217866 0.94
tpch_q22/datafusion:parquet 116432719 165935115 0.70
duckdb / vortex-file-compressed (0.939x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 256203799 256815344 1.00
tpch_q02/duckdb:vortex-file-compressed 961741740 1009307085 0.95
tpch_q03/duckdb:vortex-file-compressed 658079247 606837973 1.08
tpch_q04/duckdb:vortex-file-compressed 372156709 509340829 0.73
tpch_q05/duckdb:vortex-file-compressed 814194817 934300926 0.87
tpch_q06/duckdb:vortex-file-compressed 386377290 353713342 1.09
tpch_q07/duckdb:vortex-file-compressed 869229035 1017603776 0.85
tpch_q08/duckdb:vortex-file-compressed 998349958 966955897 1.03
tpch_q09/duckdb:vortex-file-compressed 935416803 914214328 1.02
tpch_q10/duckdb:vortex-file-compressed 711076172 703615098 1.01
tpch_q11/duckdb:vortex-file-compressed 532412429 496313890 1.07
tpch_q12/duckdb:vortex-file-compressed 614913956 660813343 0.93
tpch_q13/duckdb:vortex-file-compressed 432975029 451653803 0.96
tpch_q14/duckdb:vortex-file-compressed 395007890 437313068 0.90
tpch_q15/duckdb:vortex-file-compressed 238493662 332248824 0.72
tpch_q16/duckdb:vortex-file-compressed 328239960 332898978 0.99
tpch_q17/duckdb:vortex-file-compressed 677187850 724787203 0.93
tpch_q18/duckdb:vortex-file-compressed 544369835 584506892 0.93
tpch_q19/duckdb:vortex-file-compressed 481912842 496272725 0.97
tpch_q20/duckdb:vortex-file-compressed 779522621 819684719 0.95
tpch_q21/duckdb:vortex-file-compressed 963844129 1132567779 0.85
tpch_q22/duckdb:vortex-file-compressed 266406005 293420421 0.91
duckdb / vortex-compact (0.960x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 289409071 270433969 1.07
tpch_q02/duckdb:vortex-compact 907474387 976627820 0.93
tpch_q03/duckdb:vortex-compact 687794949 654881028 1.05
tpch_q04/duckdb:vortex-compact 397535454 412826953 0.96
tpch_q05/duckdb:vortex-compact 779564267 868565946 0.90
tpch_q06/duckdb:vortex-compact 336427639 357367537 0.94
tpch_q07/duckdb:vortex-compact 858018277 887014142 0.97
tpch_q08/duckdb:vortex-compact 929704221 841577560 1.10
tpch_q09/duckdb:vortex-compact 911318149 997360069 0.91
tpch_q10/duckdb:vortex-compact 756217136 730324118 1.04
tpch_q11/duckdb:vortex-compact 475039925 462954197 1.03
tpch_q12/duckdb:vortex-compact 542383966 578091855 0.94
tpch_q13/duckdb:vortex-compact 364031642 457150485 0.80
tpch_q14/duckdb:vortex-compact 387122340 377705791 1.02
tpch_q15/duckdb:vortex-compact 297512964 334130019 0.89
tpch_q16/duckdb:vortex-compact 324548036 328409370 0.99
tpch_q17/duckdb:vortex-compact 583956986 647872969 0.90
tpch_q18/duckdb:vortex-compact 490902769 477638319 1.03
tpch_q19/duckdb:vortex-compact 428680725 467130473 0.92
tpch_q20/duckdb:vortex-compact 749689466 748307054 1.00
tpch_q21/duckdb:vortex-compact 935587225 1082104395 0.86
tpch_q22/duckdb:vortex-compact 271801791 294189800 0.92
duckdb / parquet (0.964x ➖, 0↑ 0↓)
name PR 5ecbcb7 (ns) base 667e1d7 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 425098998 433661157 0.98
tpch_q02/duckdb:parquet 1043213011 1125251714 0.93
tpch_q03/duckdb:parquet 1034242756 1059879729 0.98
tpch_q04/duckdb:parquet 564810483 661630633 0.85
tpch_q05/duckdb:parquet 1191777748 1158829300 1.03
tpch_q06/duckdb:parquet 400037369 431067814 0.93
tpch_q07/duckdb:parquet 1142319029 1220559999 0.94
tpch_q08/duckdb:parquet 1450221236 1528768481 0.95
tpch_q09/duckdb:parquet 1322804031 1373959060 0.96
tpch_q10/duckdb:parquet 1195088786 1236846525 0.97
tpch_q11/duckdb:parquet 721833835 728296069 0.99
tpch_q12/duckdb:parquet 671917765 692000387 0.97
tpch_q13/duckdb:parquet 872484076 913475167 0.96
tpch_q14/duckdb:parquet 686987102 704035690 0.98
tpch_q15/duckdb:parquet 524256058 620655102 0.84
tpch_q16/duckdb:parquet 601942863 671305570 0.90
tpch_q17/duckdb:parquet 813611735 752564442 1.08
tpch_q18/duckdb:parquet 943193017 889110021 1.06
tpch_q19/duckdb:parquet 810381170 846703995 0.96
tpch_q20/duckdb:parquet 1170249685 1172300525 1.00
tpch_q21/duckdb:parquet 1163257587 1035560188 1.12
tpch_q22/duckdb:parquet 549530488 609347224 0.90
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.1% -18.6% +21.5% +74.9% ➖ noise
1 datafusion:vortex-file-compressed -1.9% -18.6% +20.5% +62.3% ➖ noise
1 duckdb:vortex-compact +7.0% -18.6% +31.4% +46.7% ➖ noise
1 duckdb:vortex-file-compressed -0.2% -18.6% +22.5% +45.7% ➖ noise
2 datafusion:vortex-compact -36.1% -5.0% -32.8% +36.6% ✅ faster
2 datafusion:vortex-file-compressed -17.6% -5.0% -13.2% +30.0% ➖ noise
2 duckdb:vortex-compact -7.1% -5.0% -2.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -4.7% -5.0% +0.3% +30.0% ➖ noise
3 datafusion:vortex-compact -5.3% -13.0% +8.9% +51.7% ➖ noise
3 datafusion:vortex-file-compressed -16.1% -13.0% -3.5% +48.3% ➖ noise
3 duckdb:vortex-compact +5.0% -13.0% +20.7% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +8.4% -13.0% +24.7% +32.2% ➖ noise
4 datafusion:vortex-compact -3.2% -1.9% -1.4% +40.8% ➖ noise
4 datafusion:vortex-file-compressed -19.2% -1.9% -17.7% +30.0% ➖ noise
4 duckdb:vortex-compact -3.7% -1.9% -1.8% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -26.9% -1.9% -25.5% +30.0% ✅ faster
5 datafusion:vortex-compact -0.6% +6.8% -6.9% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -6.0% +6.8% -12.0% +30.0% ➖ noise
5 duckdb:vortex-compact -10.2% +6.8% -15.9% +75.1% ➖ noise
5 duckdb:vortex-file-compressed -12.9% +6.8% -18.4% +30.0% ➖ noise
6 datafusion:vortex-compact -14.5% +10.7% -22.8% +39.7% ➖ noise
6 datafusion:vortex-file-compressed +0.2% +10.7% -9.5% +30.0% ➖ noise
6 duckdb:vortex-compact -5.9% +10.7% -15.0% +36.1% ➖ noise
6 duckdb:vortex-file-compressed +9.2% +10.7% -1.3% +30.0% ➖ noise
7 datafusion:vortex-compact +5.1% -5.1% +10.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -1.5% -5.1% +3.9% +30.0% ➖ noise
7 duckdb:vortex-compact -3.3% -5.1% +2.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -14.6% -5.1% -10.0% +30.0% ➖ noise
8 datafusion:vortex-compact +0.6% -8.7% +10.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -0.8% -8.7% +8.6% +30.0% ➖ noise
8 duckdb:vortex-compact +10.5% -8.7% +20.9% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +3.2% -8.7% +13.0% +30.0% ➖ noise
9 datafusion:vortex-compact -5.9% -7.4% +1.6% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -11.2% -7.4% -4.2% +30.0% ➖ noise
9 duckdb:vortex-compact -8.6% -7.4% -1.4% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +2.3% -7.4% +10.4% +30.0% ➖ noise
10 datafusion:vortex-compact +18.2% +3.0% +14.8% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -28.5% +3.0% -30.6% +30.0% ✅ faster
10 duckdb:vortex-compact +3.5% +3.0% +0.6% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +1.1% +3.0% -1.9% +30.0% ➖ noise
11 datafusion:vortex-compact +0.0% -1.0% +1.0% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -16.6% -1.0% -15.8% +30.0% ➖ noise
11 duckdb:vortex-compact +2.6% -1.0% +3.6% +35.9% ➖ noise
11 duckdb:vortex-file-compressed +7.3% -1.0% +8.3% +30.0% ➖ noise
12 datafusion:vortex-compact +7.1% -7.6% +16.0% +31.9% ➖ noise
12 datafusion:vortex-file-compressed -6.3% -7.6% +1.4% +30.0% ➖ noise
12 duckdb:vortex-compact -6.2% -7.6% +1.6% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -6.9% -7.6% +0.7% +30.0% ➖ noise
13 datafusion:vortex-compact -15.0% -2.4% -12.9% +46.1% ➖ noise
13 datafusion:vortex-file-compressed +14.0% -2.4% +16.7% +38.7% ➖ noise
13 duckdb:vortex-compact -20.4% -2.4% -18.5% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -4.1% -2.4% -1.8% +30.0% ➖ noise
14 datafusion:vortex-compact -14.6% +5.0% -18.7% +38.5% ➖ noise
14 datafusion:vortex-file-compressed +22.3% +5.0% +16.5% +30.0% ➖ noise
14 duckdb:vortex-compact +2.5% +5.0% -2.4% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -9.7% +5.0% -14.0% +30.0% ➖ noise
15 datafusion:vortex-compact +1.5% -8.2% +10.5% +31.6% ➖ noise
15 datafusion:vortex-file-compressed -17.0% -8.2% -9.7% +30.0% ➖ noise
15 duckdb:vortex-compact -11.0% -8.2% -3.0% +30.7% ➖ noise
15 duckdb:vortex-file-compressed -28.2% -8.2% -21.8% +30.0% ➖ noise
16 datafusion:vortex-compact -14.0% -8.4% -6.1% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -8.0% -8.4% +0.5% +30.0% ➖ noise
16 duckdb:vortex-compact -1.2% -8.4% +7.9% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -1.4% -8.4% +7.7% +30.0% ➖ noise
17 datafusion:vortex-compact +11.8% +15.0% -2.8% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +12.6% +15.0% -2.1% +39.9% ➖ noise
17 duckdb:vortex-compact -9.9% +15.0% -21.6% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -6.6% +15.0% -18.7% +30.0% ➖ noise
18 datafusion:vortex-compact -3.4% +7.3% -10.0% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -4.0% +7.3% -10.6% +33.5% ➖ noise
18 duckdb:vortex-compact +2.8% +7.3% -4.3% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -6.9% +7.3% -13.2% +30.0% ➖ noise
19 datafusion:vortex-compact +15.0% -10.9% +29.0% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +2.1% -10.9% +14.6% +30.0% ➖ noise
19 duckdb:vortex-compact -8.2% -10.9% +3.0% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -2.9% -10.9% +9.0% +30.0% ➖ noise
20 datafusion:vortex-compact +10.6% -5.5% +17.1% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -3.9% -5.5% +1.7% +30.0% ➖ noise
20 duckdb:vortex-compact +0.2% -5.5% +6.0% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -4.9% -5.5% +0.6% +30.0% ➖ noise
21 datafusion:vortex-compact +12.6% +3.0% +9.3% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -13.0% +3.0% -15.6% +30.0% ➖ noise
21 duckdb:vortex-compact -13.5% +3.0% -16.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -14.9% +3.0% -17.4% +30.0% ➖ noise
22 datafusion:vortex-compact +3.3% -20.5% +29.8% +34.1% ➖ noise
22 datafusion:vortex-file-compressed -28.0% -20.5% -9.5% +30.0% ➖ noise
22 duckdb:vortex-compact -7.6% -20.5% +16.1% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -9.2% -20.5% +14.1% +30.0% ➖ noise

@claude
Reduce Delta selection penalty (delta tax 10% -> 5%)
5ecbcb7 
Lower DELTA_PENALTY from 0.9 to 0.95 so Delta is chosen more readily,
requiring it to be only ~5% smaller than the best alternative rather than
~10%. This widens Delta's applicability for benchmarking its effect on
query performance.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jun 2, 2026 — with Claude
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jun 2, 2026
@joseph-isaacs joseph-isaacs added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jun 2, 2026 — with Claude
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jun 2, 2026
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Jun 3, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 3, 2026
@joseph-isaacs joseph-isaacs marked this pull request as ready for review June 3, 2026 13:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 Awaiting requested review from robert3005

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

changelog/feature A new feature

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@joseph-isaacs @claude